-- Logs begin at Tue 2022-08-02 08:28:55 UTC, end at Tue 2022-08-02 10:00:40 UTC. -- Aug 02 09:01:58.710216 dv-cinder-803823-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 09:01:58.719137 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:01:58 2022] *** Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: nodename: dv-cinder-803823-15-iscsi Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: machine: x86_64 Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: clock source: unix Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: pcre jit disabled Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: detected number of CPU cores: 4 Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: current working directory: / Aug 02 09:01:58.720938 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: your processes number limit is 47680 Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: your memory page size is 4096 bytes Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: detected max file descriptor number: 2048 Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: lock engine: pthread robust mutexes Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: thunder lock: enabled Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 09:01:58.721738 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:01:58.761332 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: Python main interpreter initialized at 0x557dc94219c0 Aug 02 09:01:58.761332 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: python threads support enabled Aug 02 09:01:58.761332 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: your server socket listen backlog is limited to 100 connections Aug 02 09:01:58.761332 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:01:58.761668 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:01:58.761754 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: *** Operational MODE: preforking *** Aug 02 09:01:58.762018 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:01:58.762018 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: spawned uWSGI master process (pid: 103354) Aug 02 09:01:58.762205 dv-cinder-803823-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 09:01:58.765138 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: spawned uWSGI worker 1 (pid: 103355, cores: 1) Aug 02 09:01:58.765138 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: spawned uWSGI worker 2 (pid: 103356, cores: 1) Aug 02 09:01:58.765138 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:01:59.420164 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:01:59.420828 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:02:00.497916 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:00.497916 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: from cryptography.utils import int_from_bytes Aug 02 09:02:00.498530 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:00.498530 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: from cryptography.utils import int_from_bytes Aug 02 09:02:00.501188 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:00.501188 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: from cryptography.utils import int_from_bytes Aug 02 09:02:00.501656 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:02:00.501656 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: from cryptography.utils import int_from_bytes Aug 02 09:02:02.956225 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:02:02.956718 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:02:02.956988 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:02:02.957379 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:02:02.957631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:02:02.958016 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.958253 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:02:02.958606 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.958705 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:02:02.958807 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.958962 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.959068 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:02:02.959275 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.959379 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:02:02.959576 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.959664 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:02:02.959891 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.959987 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.960206 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.960302 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.960528 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.960621 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.960784 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.960923 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.961098 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.961285 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.961443 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-15-iscsi {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.961600 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.961761 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.961924 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.962065 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.962424 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.962546 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.962739 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.962890 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.963038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.963156 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.963358 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.963476 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.963659 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.963805 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-15-iscsi {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.964134 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.964310 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.964446 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.965340 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.965486 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.965643 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.965781 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.965923 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966058 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966183 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966306 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966448 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966569 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966698 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966698 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.966930 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967070 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967193 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967352 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967478 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967609 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967748 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.967879 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-15-iscsi {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968004 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968135 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968266 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968399 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968531 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968656 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968778 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.968902 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.969023 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.969263 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.969399 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.969645 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.969790 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.969917 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970049 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-15-iscsi {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970192 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970319 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970451 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970576 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970764 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.970904 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971078 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971400 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971555 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971687 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971866 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.971994 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.972188 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.972319 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.972512 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.972641 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.972823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.972959 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973150 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973283 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973456 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973585 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973708 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973832 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.973997 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.974127 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.974314 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.974455 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.974631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.974773 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.974949 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975089 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975221 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975355 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975481 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975619 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975745 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.975868 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976031 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976160 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976336 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976473 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976638 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976766 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.976939 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.977075 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.977272 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.977409 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.977571 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.977700 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.978333 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.978588 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.978722 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.978848 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.978980 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.979107 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.979262 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.979439 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.979574 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.979834 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.979970 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980102 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980227 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980359 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980492 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980615 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980746 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.980872 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981039 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981313 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981443 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981575 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981699 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981829 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.981963 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.982092 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.982288 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.982415 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.982594 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.982719 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.982907 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983034 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983211 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983345 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983511 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983647 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983815 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.983957 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.984128 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.984255 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.984454 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.984582 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.984753 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.984882 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985011 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985156 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985307 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985448 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985607 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985747 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.985920 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986049 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986221 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986370 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986521 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986649 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986819 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.986946 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.987113 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.987250 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.987410 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.987538 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.987710 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.987837 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988007 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988144 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988306 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988441 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988610 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988745 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.988906 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.989043 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.989222 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.989350 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.989515 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.989641 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.989912 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990045 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990171 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990296 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990420 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990552 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990686 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990812 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.990943 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991070 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991247 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991386 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991548 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991685 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991848 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.991976 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.992148 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.992276 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.992449 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.992579 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.992765 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.992901 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.993066 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.993227 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.993392 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.994145 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.994284 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.994563 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.994707 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.994835 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.994976 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995102 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995235 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995362 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995487 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995611 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995749 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.995875 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996057 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996186 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996363 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996492 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996666 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996795 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.996965 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.997104 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.997289 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.997437 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.997590 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.997730 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.997890 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998018 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998189 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998331 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998493 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998629 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998786 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.998922 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.999084 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.999222 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.999387 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.999567 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.999697 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:02.999821 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000080 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000218 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000352 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000478 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000604 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000727 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.000860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.001001 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.001156 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.001283 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.001455 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.001593 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.001781 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.001911 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.002092 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.002229 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.002400 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.002530 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.002707 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.002837 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.003026 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:02:03.003155 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.003355 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.003492 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.003678 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.003809 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.003986 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.004114 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.004293 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.004436 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.004600 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.004729 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.004913 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.005049 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.005291 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.005430 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.005607 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.005737 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.005926 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006055 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006235 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006371 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006550 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006704 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006844 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.006973 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.007156 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.007293 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.007478 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.007614 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.007793 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.007928 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.008101 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.008240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.008422 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.008557 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.008740 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.008870 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.009407 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.009648 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.009809 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.009947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010219 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010351 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010351 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010604 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010737 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010864 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.010988 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011114 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011253 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011386 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011512 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011643 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011768 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.011891 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012024 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012158 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012283 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012407 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012540 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012673 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012806 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.012938 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013064 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013208 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013334 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013472 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013599 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013760 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.013889 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.014074 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.014203 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.014398 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.014531 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.014713 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.014849 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015026 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015162 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015339 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015468 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015652 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015861 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.015989 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016119 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016258 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016392 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016525 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016650 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016808 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.016945 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.017122 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.017254 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.017446 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.017587 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.017770 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.017912 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.018072 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.018201 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.018406 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.018543 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.018711 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.018846 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019016 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019384 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019384 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019584 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019740 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019879 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.019879 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.020116 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.020397 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.020532 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.020671 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.020807 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.020933 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021068 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021249 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021377 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021510 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021638 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021763 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.021894 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022019 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022144 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022276 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022409 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022560 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022691 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.022873 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023003 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023181 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023311 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023492 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023620 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023801 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.023942 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.024109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.024238 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.024418 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.024545 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.024754 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.024926 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.025091 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.025254 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.025418 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.025560 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.025750 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.025893 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026056 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026185 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026380 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026593 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026723 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026858 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.026984 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.027109 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.027291 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.027420 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.027597 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.027735 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.027899 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028028 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028201 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028336 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028508 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028638 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028813 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.028943 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.029144 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.029277 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.029438 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.029592 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.029728 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.029915 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.030045 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.030226 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.030572 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.030702 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.030834 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.030960 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031094 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031232 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031358 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031483 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031614 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031748 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.031873 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032006 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032133 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032295 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032431 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032601 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032730 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.032907 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.033043 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.033250 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.033394 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.033578 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.033708 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.033888 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034019 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034195 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034323 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034501 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034639 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034806 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.034937 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.035110 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.035239 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.035417 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.035555 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.035734 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.035864 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036043 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036172 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036358 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036495 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036662 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036792 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.036981 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.037169 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.037299 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.037438 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.037608 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.037737 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.037910 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038041 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038221 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038364 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038531 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038659 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038855 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.038984 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.039170 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.039307 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.039484 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.039612 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.039790 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.039951 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.040086 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.040213 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.040965 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.041097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.041247 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.041422 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.041562 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.041736 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.041867 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042048 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042169 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042366 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042503 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042677 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042807 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.042994 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.043132 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.043301 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.043431 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.043621 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.043751 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.043928 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044058 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044242 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044372 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044544 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044673 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044854 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.044983 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.045200 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.045332 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.045526 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.045664 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.045830 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.045966 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.046138 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.046268 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.046456 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.046584 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.046763 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.046890 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047067 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047195 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047374 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047501 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047675 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047813 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.047978 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.048107 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.048288 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.048418 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.048597 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.048735 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.048902 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.049031 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.049230 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.049360 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.049533 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.049676 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.049845 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050016 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050143 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050274 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050435 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050573 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050734 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.050863 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051124 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051253 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051387 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051513 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051637 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051769 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.051935 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052064 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052232 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052361 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052534 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052661 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052833 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.052961 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.053194 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.053330 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.053456 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.053580 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.053747 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.053875 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054045 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054181 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054345 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054475 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054678 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054813 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.054982 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.055116 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.055283 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.055412 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.055585 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.055720 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.055898 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.056055 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.056264 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.056391 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.056673 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.056808 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.056981 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.057129 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.057311 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.057440 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.057631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.057773 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.057944 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.058077 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.058248 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.058377 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.058560 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.058689 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.058866 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059001 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059172 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059301 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059502 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059630 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059785 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.059911 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060087 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060214 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060381 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060512 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060687 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.060987 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.061317 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.061465 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.061593 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.061717 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.061841 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.061966 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.062174 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.062305 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.062507 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.062648 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.062823 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.062952 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.063133 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.063261 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.063447 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.063577 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.063755 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.063893 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.064069 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.064199 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.064390 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.064519 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.064721 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.064958 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.065097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.065327 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.065458 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.065634 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.065762 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.065937 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066058 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066243 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066373 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066546 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066677 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066849 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.066986 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.067153 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.067281 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.067461 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.067598 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.067764 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.067903 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068068 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068205 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068375 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068511 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068679 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068810 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.068993 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.069169 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.069321 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.069450 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.069631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.069760 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.069934 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070064 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070232 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070358 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070537 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070666 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070836 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.070965 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.071138 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.071411 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.072109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.072244 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.072380 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.072496 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.072658 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.072788 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073016 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073183 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073358 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073486 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073686 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073815 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.073989 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.074126 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.074294 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.074432 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.074598 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.074725 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.074908 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075046 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075206 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075333 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075510 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075639 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075817 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.075958 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.076122 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.076252 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.076422 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.076551 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.076731 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.076861 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077036 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077202 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077368 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077497 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077677 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077807 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.077978 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.078107 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.078288 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.078416 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.078589 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.078719 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.078900 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079029 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079204 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079339 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079502 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079630 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079802 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.079931 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.080108 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.080290 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.080419 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.080548 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.080696 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.080825 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081000 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081160 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081322 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081580 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081711 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081834 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.081958 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082096 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082229 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082354 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082480 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082601 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082786 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.082924 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083091 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083220 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083389 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083527 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083727 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083861 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.083996 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.084123 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.084286 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.084414 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.084585 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.084715 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.084886 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085014 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085203 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085333 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085505 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085637 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085812 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.085951 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.086115 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.086243 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.086427 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.086555 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.086726 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.086855 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.087030 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.087184 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.087386 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.087517 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.087707 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.087908 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088050 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088214 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088345 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088528 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088665 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088829 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.088959 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.089162 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.089296 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.089455 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.089584 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.089756 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.089895 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090044 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090173 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090360 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090498 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090664 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090806 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.090964 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.091093 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.091264 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.091393 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.091663 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.091807 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.091943 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092084 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092344 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092477 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092611 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092746 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.092873 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093044 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093186 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093378 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093521 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093687 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093824 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.093986 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.094120 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.094294 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.094430 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.094595 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.094726 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.094907 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095039 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095215 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095346 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095524 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095661 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095825 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.095962 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.096126 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.096264 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.096442 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.096571 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.096750 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.096879 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.097053 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.097256 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.097386 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.097519 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.097702 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.097859 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098017 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098156 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098317 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098445 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098619 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098756 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.098922 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099049 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099226 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099355 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099532 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099670 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099838 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.099975 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.100143 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.100273 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.100437 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.100567 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.100743 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.100872 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.101050 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.101212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.101383 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.101529 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.101791 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.101927 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.102060 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.102192 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.102328 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.102455 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.102587 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.102713 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.103390 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.103522 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.103706 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.103904 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104052 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104178 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104303 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104430 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104614 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104745 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.104926 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.105056 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.105264 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.105394 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.105574 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.105741 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.105901 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106053 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106215 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106356 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106523 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106653 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106835 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.106971 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.107143 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.107285 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.107456 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.107586 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.107763 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.107899 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.108110 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.108247 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.108495 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.108623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.108807 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.108935 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.109131 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.109281 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.109443 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.109570 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.109746 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.109882 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110048 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110178 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110354 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110531 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110650 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110781 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.110962 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.111090 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.111262 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.111398 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.111563 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.111692 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.111960 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112092 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112217 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112342 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112466 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112590 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112841 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.112972 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.113183 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.113313 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.113489 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.113631 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.113793 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.113929 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.114099 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.114228 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.114423 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.114561 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.114729 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.114858 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.115052 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.115189 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.115398 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.115534 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.115700 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.115831 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116013 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116142 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116319 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116461 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116639 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116768 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.116960 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.117155 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.117303 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.117445 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.117572 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.117707 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.117878 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.118031 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.118195 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.118327 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.118607 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.119099 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.119238 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.119488 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.119616 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.119822 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.119959 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.120155 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.120287 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.120473 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.120637 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.120794 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.120933 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.121104 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.121257 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.121429 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.121558 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.121731 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122094 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122227 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122363 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122490 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122616 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122750 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122876 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.122991 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.123114 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.123240 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.123394 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.123604 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.123733 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.123870 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124030 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124164 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124340 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124480 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124643 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124772 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.124953 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.125082 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.125273 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.125417 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.125584 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.125713 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.125891 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126019 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126203 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126340 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126517 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126647 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126814 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.126950 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.127128 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.127256 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.127432 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.127615 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.127744 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.127870 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128009 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128147 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128306 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128436 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128646 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128784 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.128950 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.129088 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.129298 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.129428 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.129623 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.129764 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.129934 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130064 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130238 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130365 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130557 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130734 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130855 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.130980 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.131160 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.131289 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.131468 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.131606 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.131784 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.131912 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132184 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132317 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132458 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132585 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132710 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132836 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.132961 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133075 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133272 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133400 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133557 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133694 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133862 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.133998 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.134682 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.134970 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.135100 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.135274 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.135402 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.135592 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.135731 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.135895 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136024 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136199 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136327 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136505 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136634 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136810 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.136941 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.137135 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.137268 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.137437 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.137568 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.137749 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.137877 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.138060 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.138189 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.138370 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.138501 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.138684 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.138812 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139001 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139129 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139308 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139443 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139626 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139753 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.139938 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.140075 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.140249 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.140378 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.140558 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.140692 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.140871 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141007 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141189 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141318 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141503 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141632 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141814 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.141956 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.142124 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.142389 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.142517 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.142649 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.142784 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.142924 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.143052 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.143177 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.143326 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.143456 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.143714 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.143852 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144035 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144165 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144354 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144484 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144675 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144805 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.144992 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.145175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.145339 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.145469 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.145648 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.145778 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.145955 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.146085 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.146261 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.146391 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.146567 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.146697 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.146872 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.147002 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.147193 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.147396 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.147527 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.147728 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.147858 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.148046 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.148176 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.148367 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.148498 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.148682 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.148811 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.149000 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.149151 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.149342 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.149471 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.149670 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.149917 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.150053 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.150338 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.150471 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.150599 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.150725 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.150887 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151023 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151159 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151287 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151412 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151538 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151840 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.151972 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.152151 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.152427 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.152562 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.152690 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.152892 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153038 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153220 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153337 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153475 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153603 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153741 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153869 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.153995 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.154127 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.154288 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.154431 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.154606 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.154737 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.154917 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.155047 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.155230 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.155372 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.155544 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.155674 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.155868 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.156062 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.156200 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.156374 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.156505 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.156703 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.156840 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157025 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157195 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157506 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157684 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157814 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.157998 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.158137 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.158322 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.158452 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.158626 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.158763 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.158927 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.159066 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.159235 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.159366 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.159547 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.159782 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.159920 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.160102 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.160233 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.160439 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.160576 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.160737 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.160917 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.161048 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.161195 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.161369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.161512 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.161720 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.161895 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.162051 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.162231 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.162361 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.162630 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.162764 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.162900 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163026 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163152 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163285 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163452 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163595 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163756 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.163887 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164077 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164207 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164380 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164517 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164682 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164812 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.164994 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.165179 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.165831 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.166125 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.166417 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.166549 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.166721 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.166849 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167026 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167165 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167326 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167463 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167762 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.167932 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168063 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168254 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168393 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168557 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168687 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168858 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.168989 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.169195 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.169337 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.169508 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.169633 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.169767 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.169894 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170058 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170195 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170360 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170491 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170660 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170798 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.170994 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171137 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171253 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171384 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171555 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171685 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171855 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.171990 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.172162 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.172306 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.172463 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.172730 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.172858 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.172984 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.173168 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.173311 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.173440 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.173562 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.173715 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.173845 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174013 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174149 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174318 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174447 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174620 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174748 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.174932 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175073 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175238 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175365 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175542 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175673 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175848 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.175976 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.176163 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.176292 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.176471 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.176693 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.176838 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.177022 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.177169 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.177367 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.177510 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.177696 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.177836 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178022 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178151 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178325 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178455 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178628 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178759 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.178928 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.179059 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.179247 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.179377 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.179555 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.179686 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.179867 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.180007 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.180170 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.180313 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.180477 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.180728 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.180857 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.181094 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.181259 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.181449 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.181597 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.181786 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.181916 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.182121 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.182251 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.182450 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.182579 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.182846 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.182981 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183110 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183235 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183370 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183497 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183611 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183744 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183871 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.183997 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.184205 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.184336 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.184518 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.184648 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.184828 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.184965 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.185158 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.185291 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.185475 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.185605 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.185779 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.185916 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.186084 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.186221 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.186389 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.186518 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.186694 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.186832 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187004 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187139 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187316 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187445 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187621 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187757 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.187922 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.188051 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.188262 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.188391 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.188582 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.188719 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.188906 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189036 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189229 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189358 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189541 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189672 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189861 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.189999 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.190174 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.190304 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.190480 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.190615 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.190788 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.190931 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.191091 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.191263 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.191415 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.191537 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.191726 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.191860 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.192033 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.192171 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.192363 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.192499 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.192665 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.192924 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193062 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193239 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193494 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193621 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193735 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.193867 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194000 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194158 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194318 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194448 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194633 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194774 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.194955 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.195092 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.195270 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.195399 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.195598 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.195735 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.195897 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.196034 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.196196 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.196325 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.196500 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.197284 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.197653 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.197780 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.198378 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.198378 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.198378 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199036 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199036 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199285 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199411 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199536 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199671 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199798 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.199925 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.200074 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.200203 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.200398 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.200539 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.200697 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.200838 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201024 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201173 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201373 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201503 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201682 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201817 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.201992 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.202121 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.202298 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.202426 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.202605 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.202733 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203013 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203153 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203295 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203422 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203547 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203670 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203794 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.203917 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.204097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.204225 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.204403 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.204531 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.204790 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.204941 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205071 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205367 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205504 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205632 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205771 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.205898 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206024 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206207 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206345 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206518 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206655 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206837 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.206983 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.207141 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.207272 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.207464 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.207595 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.207776 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.207906 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.208090 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.208219 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.208397 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.208526 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.208707 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.208836 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209028 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209187 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209358 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209487 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209667 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209796 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.209974 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.210112 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.210287 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.210418 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.210595 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.210725 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.210907 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.211046 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.211215 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.211385 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.211513 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.211639 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.211821 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.212026 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.212174 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.212820 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.212974 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.213254 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.213394 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.213532 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.213659 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.213784 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.213943 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.214110 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.214249 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.214437 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.214567 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.214779 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.214985 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.215121 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.215258 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.215415 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.215552 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.215740 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.215869 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216051 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216189 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216359 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216500 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216661 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216798 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.216933 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:02:03.217060 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.217316 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.217633 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.217950 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.218271 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.218591 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.218922 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.219252 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.219567 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.219896 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.220226 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.220581 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.220901 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.221274 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.221607 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.221928 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.222242 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.222551 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:02:03.222797 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:02:03.371168 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO dbcounter [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Registered counter for database nova_api Aug 02 09:02:03.376713 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Registered counter for database nova_api Aug 02 09:02:03.393169 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_db.sqlalchemy.engines [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.397299 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.399714 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writer thread running {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.403698 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.454913 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.context [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1278ed9-9478-4b17-bf68-714d9637c6d4(cell1) {{(pid=103355) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:02:03.458788 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_concurrency.lockutils [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:03.459140 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.context [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1278ed9-9478-4b17-bf68-714d9637c6d4(cell1) {{(pid=103356) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:02:03.460358 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_concurrency.lockutils [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:03.461184 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_concurrency.lockutils [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:03.463683 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_concurrency.lockutils [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:03.463787 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:03.465325 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:03.465679 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO dbcounter [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Registered counter for database nova_cell0 Aug 02 09:02:03.466149 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:02:03.468116 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:02:03.470138 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Registered counter for database nova_cell0 Aug 02 09:02:03.471051 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO dbcounter [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Registered counter for database nova_cell1 Aug 02 09:02:03.475508 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Registered counter for database nova_cell1 Aug 02 09:02:03.478817 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_db.sqlalchemy.engines [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.481317 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_db.sqlalchemy.engines [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.483306 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.484729 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.488203 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writer thread running {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.489524 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.490410 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writer thread running {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.628664 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.633473 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO dbcounter [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Registered counter for database nova_cell0 Aug 02 09:02:03.638074 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Registered counter for database nova_cell0 Aug 02 09:02:03.642320 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG oslo_db.sqlalchemy.engines [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.646832 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:02:03.647081 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writer thread running {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.651911 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:02:03.983701 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: WARNING keystonemiddleware.auth_token [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:02:03.986118 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:02:03.991069 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: WARNING keystonemiddleware.auth_token [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:02:03.993404 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:02:04.331271 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: WARNING keystonemiddleware.auth_token [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:02:04.335218 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:02:04.337878 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: WARNING keystonemiddleware.auth_token [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:02:04.341764 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:02:04.343413 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557dc94219c0 pid: 103355 (default app) Aug 02 09:02:04.345508 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:04.346674 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-863aa1e7-d157-4bfc-ba51-69051e6b9364 None None] 10.222.0.100 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001754 Aug 02 09:02:04.346994 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557dc94219c0 pid: 103356 (default app) Aug 02 09:02:04.347093 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 793 bytes} [Tue Aug 2 09:02:04 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:21.181873 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:21.183786 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002665 Aug 02 09:03:21.184291 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 1/2] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:21 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:21.196468 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writing DB stats nova_api:SELECT=3 {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.197473 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writing DB stats nova_cell1:SELECT=3 {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.198482 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writing DB stats nova_cell0:SELECT=3 {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.199484 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:22.083244 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-a0146b39-bda4-4cad-b805-60d52dcb07c9 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:22.121054 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-a0146b39-bda4-4cad-b805-60d52dcb07c9 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930483 Aug 02 09:03:22.122143 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 2/3] 10.222.0.100 () {60 vars in 1296 bytes} [Tue Aug 2 09:03:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:24.567295 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:24.568298 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-bca484dd-bb77-4f52-9213-51a07afa1859 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002001 Aug 02 09:03:24.570158 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 2/4] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:24 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:25.138824 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-377c075a-80eb-4d7c-ab8f-e5fe0d59ee37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:25.159629 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:03:25.159629 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: warnings.warn(msg) Aug 02 09:03:25.189317 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-377c075a-80eb-4d7c-ab8f-e5fe0d59ee37 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.614146 Aug 02 09:03:25.190092 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 3/5] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:25.204388 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=3 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.205699 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell1:SELECT=3 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.207618 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell0:SELECT=3 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.208874 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:25.419796 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-daa54e8a-1209-4773-997d-ac02d9474c47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:25.424164 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:03:25.424164 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Aug 02 09:03:25.493592 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-daa54e8a-1209-4773-997d-ac02d9474c47 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294990 Aug 02 09:03:25.494184 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 3/6] 10.222.0.100 () {64 vars in 1340 bytes} [Tue Aug 2 09:03:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:27.763362 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-377c075a-80eb-4d7c-ab8f-e5fe0d59ee37 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:27.764379 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-377c075a-80eb-4d7c-ab8f-e5fe0d59ee37 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Aug 02 09:03:27.764964 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 4/7] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:27 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:28.442459 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-41d78eee-0f7e-4e96-87b2-0c033c9d9663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:28.463020 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:03:28.463020 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Aug 02 09:03:28.484652 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-41d78eee-0f7e-4e96-87b2-0c033c9d9663 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.712355 Aug 02 09:03:28.485701 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 4/8] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:03:28.498065 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-df30cade-316c-4dc6-a32f-6d8fd23997ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:28.500870 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:03:28.500870 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: warnings.warn(msg) Aug 02 09:03:28.534043 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-df30cade-316c-4dc6-a32f-6d8fd23997ba admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039630 Aug 02 09:03:28.535610 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 5/9] 10.222.0.100 () {64 vars in 1340 bytes} [Tue Aug 2 09:03:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:30.782127 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-41d78eee-0f7e-4e96-87b2-0c033c9d9663 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:30.783141 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-41d78eee-0f7e-4e96-87b2-0c033c9d9663 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001454 Aug 02 09:03:30.783539 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 5/10] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:31.199998 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-2158cb6c-d996-4762-bb02-b5dca7f53860 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:31.220820 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-2158cb6c-d996-4762-bb02-b5dca7f53860 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430816 Aug 02 09:03:31.221424 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 6/11] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:31.233541 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8521216b-a908-452d-99da-f42f227a7e61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:31.259880 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-8521216b-a908-452d-99da-f42f227a7e61 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030156 Aug 02 09:03:31.260554 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 6/12] 10.222.0.100 () {64 vars in 1340 bytes} [Tue Aug 2 09:03:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:33.510272 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-2158cb6c-d996-4762-bb02-b5dca7f53860 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:33.511357 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-2158cb6c-d996-4762-bb02-b5dca7f53860 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001598 Aug 02 09:03:33.511771 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 7/13] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:33 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:33.954211 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-868d29ee-bc6e-4cdb-b448-473e7240bdef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:33.972995 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-868d29ee-bc6e-4cdb-b448-473e7240bdef admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455103 Aug 02 09:03:33.974141 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 7/14] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:33.992766 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-d8df578c-fe01-454e-9f82-8cbe6c3c1834 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:34.018617 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-d8df578c-fe01-454e-9f82-8cbe6c3c1834 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036706 Aug 02 09:03:34.019277 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 8/15] 10.222.0.100 () {64 vars in 1340 bytes} [Tue Aug 2 09:03:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:36.424606 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-868d29ee-bc6e-4cdb-b448-473e7240bdef admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:36.425766 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-868d29ee-bc6e-4cdb-b448-473e7240bdef admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001555 Aug 02 09:03:36.426204 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 8/16] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:36 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:36.877791 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-c30abc74-8fb0-490d-81db-93324c0e5f71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:36.904995 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-c30abc74-8fb0-490d-81db-93324c0e5f71 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.469832 Aug 02 09:03:36.909578 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 9/17] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:36.915717 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-92080669-d644-4201-a5d9-6598fd5e25e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:36.942072 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-92080669-d644-4201-a5d9-6598fd5e25e7 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030122 Aug 02 09:03:36.943186 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 9/18] 10.222.0.100 () {64 vars in 1340 bytes} [Tue Aug 2 09:03:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:39.242560 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-c30abc74-8fb0-490d-81db-93324c0e5f71 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:39.243854 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-c30abc74-8fb0-490d-81db-93324c0e5f71 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001916 Aug 02 09:03:39.244418 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 10/19] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:39 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:39.742048 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-89b71ef7-3787-4b08-8a76-bc1fe567d5bf admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:39.773336 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-89b71ef7-3787-4b08-8a76-bc1fe567d5bf admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.521058 Aug 02 09:03:39.774189 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 10/20] 10.222.0.100 () {60 vars in 1296 bytes} [Tue Aug 2 09:03:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:03:42.045502 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-c30abc74-8fb0-490d-81db-93324c0e5f71 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:42.046517 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-c30abc74-8fb0-490d-81db-93324c0e5f71 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001521 Aug 02 09:03:42.046892 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 11/21] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:42 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:03:42.524435 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-1efe3056-677e-4101-b646-3cbbeb7dcc75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:42.544314 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-1efe3056-677e-4101-b646-3cbbeb7dcc75 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490512 Aug 02 09:03:42.544883 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 11/22] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:42.558362 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-e82c8553-bf0f-4f3d-a0a6-03f95e139530 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:42.585991 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-e82c8553-bf0f-4f3d-a0a6-03f95e139530 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031898 Aug 02 09:03:42.586526 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 12/23] 10.222.0.100 () {64 vars in 1337 bytes} [Tue Aug 2 09:03:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:44.912303 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-1efe3056-677e-4101-b646-3cbbeb7dcc75 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:44.913354 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-1efe3056-677e-4101-b646-3cbbeb7dcc75 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Aug 02 09:03:44.913964 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 12/24] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:44 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:45.332863 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-cc58bd5d-64bd-4346-bf0e-51d38f2e3506 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:45.352474 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-cc58bd5d-64bd-4346-bf0e-51d38f2e3506 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.432162 Aug 02 09:03:45.359911 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 13/25] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:45.365642 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-1aea1456-a55a-4678-9efb-4ae2b7060267 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:45.390553 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-1aea1456-a55a-4678-9efb-4ae2b7060267 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029286 Aug 02 09:03:45.391137 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 13/26] 10.222.0.100 () {64 vars in 1337 bytes} [Tue Aug 2 09:03:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:47.657071 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-cc58bd5d-64bd-4346-bf0e-51d38f2e3506 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:47.658426 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-cc58bd5d-64bd-4346-bf0e-51d38f2e3506 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002216 Aug 02 09:03:47.659337 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 14/27] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:47 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:48.127241 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-2d5c8018-fba1-40aa-8b93-806ca651cd60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:48.154144 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-2d5c8018-fba1-40aa-8b93-806ca651cd60 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488458 Aug 02 09:03:48.154706 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 14/28] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:48.167651 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-971eb8ee-edab-42c9-8518-7c4da688ae93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:48.196728 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-971eb8ee-edab-42c9-8518-7c4da688ae93 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032679 Aug 02 09:03:48.197614 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 15/29] 10.222.0.100 () {64 vars in 1337 bytes} [Tue Aug 2 09:03:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:50.511834 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-2d5c8018-fba1-40aa-8b93-806ca651cd60 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:50.512861 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-2d5c8018-fba1-40aa-8b93-806ca651cd60 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 Aug 02 09:03:50.516450 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 15/30] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:50 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:51.038698 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-b7778c9c-a7c3-4608-8240-474926347f6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "disk": 80}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:51.061655 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-b7778c9c-a7c3-4608-8240-474926347f6c admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.541782 Aug 02 09:03:51.063580 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 16/31] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:03:51.075554 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-088609d8-6653-42bc-be53-ea74b72e3ad2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:51.100701 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-088609d8-6653-42bc-be53-ea74b72e3ad2 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029046 Aug 02 09:03:51.101561 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 16/32] 10.222.0.100 () {64 vars in 1337 bytes} [Tue Aug 2 09:03:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:53.354499 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-b7778c9c-a7c3-4608-8240-474926347f6c admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:53.356528 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-b7778c9c-a7c3-4608-8240-474926347f6c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002501 Aug 02 09:03:53.357533 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 17/33] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:03:53 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:53.838748 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f405f4fe-47a9-428d-a2b0-95ea6f2bb5b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "swap": 0, "disk": 160}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:53.860532 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-f405f4fe-47a9-428d-a2b0-95ea6f2bb5b4 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.497013 Aug 02 09:03:53.861289 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 17/34] 10.222.0.100 () {64 vars in 1287 bytes} [Tue Aug 2 09:03:53 2022] POST /compute/v2.1/flavors => generated 410 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:53.877020 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-aa708df6-8efb-401b-bbe9-53b1d7fb05c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:53.886895 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:53.916476 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-aa708df6-8efb-401b-bbe9-53b1d7fb05c9 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043182 Aug 02 09:03:53.917686 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 18/35] 10.222.0.100 () {64 vars in 1337 bytes} [Tue Aug 2 09:03:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:15.365411 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f405f4fe-47a9-428d-a2b0-95ea6f2bb5b4 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:15.366675 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-f405f4fe-47a9-428d-a2b0-95ea6f2bb5b4 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001501 Aug 02 09:04:15.367173 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 18/36] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:04:15 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:15.955976 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-1b683905-8118-47f4-a496-21d973526e08 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:15.976809 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-1b683905-8118-47f4-a496-21d973526e08 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.603596 Aug 02 09:04:15.977386 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 19/37] 10.222.0.100 () {60 vars in 1296 bytes} [Tue Aug 2 09:04:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:17.208218 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f405f4fe-47a9-428d-a2b0-95ea6f2bb5b4 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:17.209534 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-f405f4fe-47a9-428d-a2b0-95ea6f2bb5b4 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001718 Aug 02 09:04:17.210064 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 19/38] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:17 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:17.768744 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-315755a7-3646-4529-9bd9-0e72fdc9f87a admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:17.775341 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.wsgi [None req-315755a7-3646-4529-9bd9-0e72fdc9f87a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-315755a7-3646-4529-9bd9-0e72fdc9f87a admin admin] Request method failure captured: Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Accept: application/json Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Accept-Encoding: gzip, deflate Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Connection: keep-alive Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Content-Length: 0 Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Host: 10.222.0.100 Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Openstack-Api-Version: compute 2.90 Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Openstack-System-Scope: None Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: User-Agent: python-novaclient Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Auth-Token: gAAAAABi6OiR7eX3WQG1fBPe0FMGNvTtixBedAqJRb9wJWhIhEeDuL_hOFbGgFTPo_Q7ZXr0_Ar-g8sbm-kIy1N1cIixEVvKDegirlohSCwDSi2EiS7-WX-Gjnq0aUM6KATfKVOi7qCdHZ7mHy7DiQd3515yXfa7p1UIf18_SneOZ22lJTpes5Y Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Domain-Id: None Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Domain-Name: None Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Identity-Status: Confirmed Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Is-Admin-Project: True Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Domain-Id: default Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Domain-Name: Default Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Name: admin Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Role: member,reader,admin Aug 02 09:04:17.779175 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Roles: member,reader,admin Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant: admin Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant-Name: admin Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User: admin Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Domain-Id: default Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Domain-Name: Default Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Id: 87e4d594c1134b86837b4e4c464d9cfd Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Name: admin Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: method: > Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: exception: Flavor 42 could not be found. Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: action_args: {'id': '42'} Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:17.780876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:17.781990 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.784109 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-315755a7-3646-4529-9bd9-0e72fdc9f87a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:17.785452 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-315755a7-3646-4529-9bd9-0e72fdc9f87a admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.431775 Aug 02 09:04:17.785452 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 20/39] 10.222.0.100 () {60 vars in 1195 bytes} [Tue Aug 2 09:04:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 02 09:04:17.794163 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-ecb7512a-5b12-4459-9794-1ebb0027f15c admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:17.799158 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:17.820368 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-ecb7512a-5b12-4459-9794-1ebb0027f15c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.031542 Aug 02 09:04:17.820921 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 20/40] 10.222.0.100 () {60 vars in 1215 bytes} [Tue Aug 2 09:04:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:17.832695 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67d92088-2187-423c-be78-ab2348aff83d admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:17.860478 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67d92088-2187-423c-be78-ab2348aff83d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.032683 Aug 02 09:04:17.861273 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 21/41] 10.222.0.100 () {60 vars in 1215 bytes} [Tue Aug 2 09:04:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:17.872708 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-90b0e116-9b2f-4e61-b598-937365668e44 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:17.880407 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.wsgi [None req-90b0e116-9b2f-4e61-b598-937365668e44 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-90b0e116-9b2f-4e61-b598-937365668e44 admin admin] Request method failure captured: Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Accept: application/json Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Accept-Encoding: gzip, deflate Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Connection: keep-alive Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Content-Length: 0 Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Host: 10.222.0.100 Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Openstack-Api-Version: compute 2.90 Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Openstack-System-Scope: None Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: User-Agent: python-novaclient Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Auth-Token: gAAAAABi6OiR7eX3WQG1fBPe0FMGNvTtixBedAqJRb9wJWhIhEeDuL_hOFbGgFTPo_Q7ZXr0_Ar-g8sbm-kIy1N1cIixEVvKDegirlohSCwDSi2EiS7-WX-Gjnq0aUM6KATfKVOi7qCdHZ7mHy7DiQd3515yXfa7p1UIf18_SneOZ22lJTpes5Y Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Domain-Id: None Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Domain-Name: None Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Identity-Status: Confirmed Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Is-Admin-Project: True Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Domain-Id: default Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Domain-Name: Default Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Name: admin Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Role: member,reader,admin Aug 02 09:04:17.884315 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Roles: member,reader,admin Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant: admin Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant-Name: admin Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User: admin Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Domain-Id: default Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Domain-Name: Default Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Id: 87e4d594c1134b86837b4e4c464d9cfd Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Name: admin Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: method: > Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: exception: Flavor 42 could not be found. Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: action_args: {'id': '42'} Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:17.885860 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:17.886954 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:17.888335 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-90b0e116-9b2f-4e61-b598-937365668e44 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:17.889606 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-90b0e116-9b2f-4e61-b598-937365668e44 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017622 Aug 02 09:04:17.889606 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 21/42] 10.222.0.100 () {60 vars in 1195 bytes} [Tue Aug 2 09:04:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:19.017223 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67d92088-2187-423c-be78-ab2348aff83d admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:19.018451 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67d92088-2187-423c-be78-ab2348aff83d admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001688 Aug 02 09:04:19.019020 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 22/43] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:19.615115 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-4aa4a9b9-4271-40b9-8cc4-bff32588bb59 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:19.621689 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.wsgi [None req-4aa4a9b9-4271-40b9-8cc4-bff32588bb59 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-4aa4a9b9-4271-40b9-8cc4-bff32588bb59 admin admin] Request method failure captured: Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Accept: application/json Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Accept-Encoding: gzip, deflate Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Connection: keep-alive Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Content-Length: 0 Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Host: 10.222.0.100 Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Openstack-Api-Version: compute 2.90 Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Openstack-System-Scope: None Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: User-Agent: python-novaclient Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Auth-Token: gAAAAABi6OiSoNsfYe4Pm6Yhj7-wTHzXD3hnEqzR158UF3xu47N6NG4dqFLMzz3OZ4EzhMGk0CduonJifyqGS4cWTHpBmtVgpxSfL5isaZg4xY4DIfxSwVcAF-lkmUf1PD-LuyRjVubw2TeJBgqrg6sIx6G3INT_hXlusStxE6kIc4YoccqyeAI Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Domain-Id: None Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Domain-Name: None Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Identity-Status: Confirmed Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Is-Admin-Project: True Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Domain-Id: default Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Domain-Name: Default Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Name: admin Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Role: member,reader,admin Aug 02 09:04:19.623240 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Roles: member,reader,admin Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant: admin Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant-Name: admin Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User: admin Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Domain-Id: default Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Domain-Name: Default Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Id: 87e4d594c1134b86837b4e4c464d9cfd Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Name: admin Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: method: > Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: exception: Flavor 84 could not be found. Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: action_args: {'id': '84'} Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:19.624820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:19.625823 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.627734 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-4aa4a9b9-4271-40b9-8cc4-bff32588bb59 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:19.628998 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-4aa4a9b9-4271-40b9-8cc4-bff32588bb59 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.459644 Aug 02 09:04:19.628998 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 22/44] 10.222.0.100 () {60 vars in 1195 bytes} [Tue Aug 2 09:04:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:19.635223 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-9006f46b-a44a-42f8-8f7b-6970717d076a admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:19.651276 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-9006f46b-a44a-42f8-8f7b-6970717d076a admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019698 Aug 02 09:04:19.651840 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 23/45] 10.222.0.100 () {60 vars in 1215 bytes} [Tue Aug 2 09:04:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:19.661958 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-1aef87c1-6250-452e-8ff3-b89e5375116c admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:19.678108 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-1aef87c1-6250-452e-8ff3-b89e5375116c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019526 Aug 02 09:04:19.678706 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 23/46] 10.222.0.100 () {60 vars in 1215 bytes} [Tue Aug 2 09:04:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:04:19.689837 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-53998df3-757a-4e49-9170-7e6bd81060b5 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:19.696546 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.wsgi [None req-53998df3-757a-4e49-9170-7e6bd81060b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-53998df3-757a-4e49-9170-7e6bd81060b5 admin admin] Request method failure captured: Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Accept: application/json Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Accept-Encoding: gzip, deflate Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Connection: keep-alive Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Content-Length: 0 Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Host: 10.222.0.100 Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Openstack-Api-Version: compute 2.90 Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Openstack-System-Scope: None Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: User-Agent: python-novaclient Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Auth-Token: gAAAAABi6OiSoNsfYe4Pm6Yhj7-wTHzXD3hnEqzR158UF3xu47N6NG4dqFLMzz3OZ4EzhMGk0CduonJifyqGS4cWTHpBmtVgpxSfL5isaZg4xY4DIfxSwVcAF-lkmUf1PD-LuyRjVubw2TeJBgqrg6sIx6G3INT_hXlusStxE6kIc4YoccqyeAI Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Domain-Id: None Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Domain-Name: None Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Identity-Status: Confirmed Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Is-Admin-Project: True Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Domain-Id: default Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Domain-Name: Default Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Name: admin Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Role: member,reader,admin Aug 02 09:04:19.698382 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Roles: member,reader,admin Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant: admin Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant-Name: admin Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User: admin Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Domain-Id: default Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Domain-Name: Default Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Id: 87e4d594c1134b86837b4e4c464d9cfd Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Name: admin Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: method: > Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: exception: Flavor 84 could not be found. Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: action_args: {'id': '84'} Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:19.700369 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:19.701631 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:19.703371 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-53998df3-757a-4e49-9170-7e6bd81060b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:19.705702 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-53998df3-757a-4e49-9170-7e6bd81060b5 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015115 Aug 02 09:04:19.705702 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 24/47] 10.222.0.100 () {60 vars in 1195 bytes} [Tue Aug 2 09:04:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:20.726820 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-1aef87c1-6250-452e-8ff3-b89e5375116c admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:20.727848 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-1aef87c1-6250-452e-8ff3-b89e5375116c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001467 Aug 02 09:04:20.728251 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 24/48] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:20 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:21.346693 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-e76998b4-ba57-46b9-a253-b9a7e327cfb5 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:21.355115 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.wsgi [None req-e76998b4-ba57-46b9-a253-b9a7e327cfb5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-e76998b4-ba57-46b9-a253-b9a7e327cfb5 admin admin] Request method failure captured: Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Accept: application/json Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Accept-Encoding: gzip, deflate Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Connection: keep-alive Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Content-Length: 0 Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Host: 10.222.0.100 Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Openstack-Api-Version: compute 2.90 Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Openstack-System-Scope: None Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: User-Agent: python-novaclient Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Auth-Token: gAAAAABi6OiUwuVJ9DKvxT3JQ1eEawHVcaTcb8iT3M3_TIi-4LbeMucXS3OhUu92PfmiKxkzKxV0fIOqcm0UBGyiSqLsZ7CidpAfyduX6UXv1WZ9dA6HrT7srw2YZOGu2OsBNsbKgv9dtKrgTWup_uVLeFwH0o4q_irtWZymZjdj4-4IUoirJwc Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Domain-Id: None Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Domain-Name: None Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Identity-Status: Confirmed Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Is-Admin-Project: True Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Domain-Id: default Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Domain-Name: Default Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Project-Name: admin Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Role: member,reader,admin Aug 02 09:04:21.357038 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Roles: member,reader,admin Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant: admin Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-Tenant-Name: admin Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User: admin Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Domain-Id: default Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Domain-Name: Default Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Id: 87e4d594c1134b86837b4e4c464d9cfd Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: X-User-Name: admin Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: method: > Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: exception: Flavor 451 could not be found. Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: action_args: {'id': '451'} Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:21.359097 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:21.359947 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.361623 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-e76998b4-ba57-46b9-a253-b9a7e327cfb5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:21.362924 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-e76998b4-ba57-46b9-a253-b9a7e327cfb5 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.472496 Aug 02 09:04:21.362924 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 25/49] 10.222.0.100 () {60 vars in 1198 bytes} [Tue Aug 2 09:04:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:21.372712 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-48752872-c67f-4531-ab2d-c8311fcb151b admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:21.389748 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-48752872-c67f-4531-ab2d-c8311fcb151b admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.021864 Aug 02 09:04:21.390299 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 25/50] 10.222.0.100 () {60 vars in 1215 bytes} [Tue Aug 2 09:04:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:21.401527 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:21.419187 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.021684 Aug 02 09:04:21.419824 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 26/51] 10.222.0.100 () {60 vars in 1215 bytes} [Tue Aug 2 09:04:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:21.432096 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-51858390-0de0-40ff-ba4f-ca5a864332da admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:21.439133 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.wsgi [None req-51858390-0de0-40ff-ba4f-ca5a864332da admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-51858390-0de0-40ff-ba4f-ca5a864332da admin admin] Request method failure captured: Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Accept: application/json Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Accept-Encoding: gzip, deflate Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Connection: keep-alive Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Content-Length: 0 Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Host: 10.222.0.100 Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Openstack-Api-Version: compute 2.90 Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Openstack-System-Scope: None Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: User-Agent: python-novaclient Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Auth-Token: gAAAAABi6OiUwuVJ9DKvxT3JQ1eEawHVcaTcb8iT3M3_TIi-4LbeMucXS3OhUu92PfmiKxkzKxV0fIOqcm0UBGyiSqLsZ7CidpAfyduX6UXv1WZ9dA6HrT7srw2YZOGu2OsBNsbKgv9dtKrgTWup_uVLeFwH0o4q_irtWZymZjdj4-4IUoirJwc Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Domain-Id: None Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Domain-Name: None Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Identity-Status: Confirmed Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Is-Admin-Project: True Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Domain-Id: default Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Domain-Name: Default Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Project-Name: admin Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Role: member,reader,admin Aug 02 09:04:21.442671 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Roles: member,reader,admin Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/1b02845ab43a49ada6db1e8f52cf0026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant: admin Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant-Id: 1b02845ab43a49ada6db1e8f52cf0026 Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-Tenant-Name: admin Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User: admin Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Domain-Id: default Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Domain-Name: Default Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Id: 87e4d594c1134b86837b4e4c464d9cfd Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: X-User-Name: admin Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: method: > Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: exception: Flavor 451 could not be found. Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: action_args: {'id': '451'} Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:04:21.444212 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:21.445362 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Aug 02 09:04:21.446624 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-51858390-0de0-40ff-ba4f-ca5a864332da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:04:21.447844 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-51858390-0de0-40ff-ba4f-ca5a864332da admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017213 Aug 02 09:04:21.447844 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 26/52] 10.222.0.100 () {60 vars in 1198 bytes} [Tue Aug 2 09:04:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:04:22.438791 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:22.440539 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002213 Aug 02 09:04:22.441063 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 27/53] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:22 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:23.057070 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a30ad73c-7c63-40e9-a18e-e43dc7927ce4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:23.079074 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-a30ad73c-7c63-40e9-a18e-e43dc7927ce4 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.477510 Aug 02 09:04:23.079642 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 27/54] 10.222.0.100 () {64 vars in 1240 bytes} [Tue Aug 2 09:04:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:24.102476 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:24.103529 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001469 Aug 02 09:04:24.103939 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 28/55] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:24 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:24.791048 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-ed8aba48-a6a2-4a06-a137-14c144ff56f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:24.821394 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-ed8aba48-a6a2-4a06-a137-14c144ff56f5 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.577463 Aug 02 09:04:24.821891 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 28/56] 10.222.0.100 () {64 vars in 1240 bytes} [Tue Aug 2 09:04:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:04:25.913060 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:25.914106 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001496 Aug 02 09:04:25.914537 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 29/57] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:25 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:26.508767 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-33f408e1-2acf-44f7-b8a0-77343815237a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:26.528632 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-33f408e1-2acf-44f7-b8a0-77343815237a admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458176 Aug 02 09:04:26.529208 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 29/58] 10.222.0.100 () {64 vars in 1240 bytes} [Tue Aug 2 09:04:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:27.569190 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:27.570214 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001469 Aug 02 09:04:27.570620 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 30/59] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:27 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:28.152356 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-0fc53d43-fa09-4a39-828f-f231f6484d98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:04:28.172827 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-0fc53d43-fa09-4a39-828f-f231f6484d98 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.457946 Aug 02 09:04:28.173412 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 30/60] 10.222.0.100 () {64 vars in 1240 bytes} [Tue Aug 2 09:04:27 2022] POST /compute/v2.1/flavors => generated 411 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:04:29.209542 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.210550 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001484 Aug 02 09:04:29.210952 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 31/61] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:29.778786 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a1c941a4-e06f-4722-be25-2e612b4f1a6d admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.801423 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-a1c941a4-e06f-4722-be25-2e612b4f1a6d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.444481 Aug 02 09:04:29.801977 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 31/62] 10.222.0.100 () {60 vars in 1207 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:05:23.300813 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:23.302417 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-3f163ef2-5a25-44f6-8891-aca4d2c407c8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002275 Aug 02 09:05:23.303141 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 32/63] 10.222.0.100 () {54 vars in 935 bytes} [Tue Aug 2 09:05:23 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:05:23.318721 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:23.784331 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-c93aa577-cd23-4871-bbcc-c28aee94975d admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:23.807942 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-c93aa577-cd23-4871-bbcc-c28aee94975d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.497696 Aug 02 09:05:23.808499 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 32/64] 10.222.0.100 () {60 vars in 1296 bytes} [Tue Aug 2 09:05:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:05:23.830477 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG dbcounter [-] [103355] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:05:23.834979 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-673a3303-6920-416a-9852-43bb21c02b58 admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:23.844770 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-673a3303-6920-416a-9852-43bb21c02b58 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015851 Aug 02 09:05:23.845368 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 33/65] 10.222.0.100 () {60 vars in 1287 bytes} [Tue Aug 2 09:05:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:23.858348 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b5ea7717-5b8f-424b-9679-fcd0bcd6a0f1 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:23.866875 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b5ea7717-5b8f-424b-9679-fcd0bcd6a0f1 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012416 Aug 02 09:05:23.867502 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 33/66] 10.222.0.100 () {60 vars in 1290 bytes} [Tue Aug 2 09:05:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:23.880997 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:23.888700 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012430 Aug 02 09:05:23.889299 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 34/67] 10.222.0.100 () {60 vars in 1290 bytes} [Tue Aug 2 09:05:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:05:23.902532 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-58399b34-d143-4adc-a666-bfe57bc6d409 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:05:23.912721 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-58399b34-d143-4adc-a666-bfe57bc6d409 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014037 Aug 02 09:05:23.913348 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 34/68] 10.222.0.100 () {60 vars in 1287 bytes} [Tue Aug 2 09:05:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:52.987090 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:52.988068 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001500 Aug 02 09:08:52.988838 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 35/69] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:08:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:53.138711 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=6 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:53.303904 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-fa394d05-1829-4d51-b92a-71d944da7f5f admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:53.306297 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:08:53.306297 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Aug 02 09:08:53.307499 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-fa394d05-1829-4d51-b92a-71d944da7f5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.307949 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-fa394d05-1829-4d51-b92a-71d944da7f5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.308728 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-fa394d05-1829-4d51-b92a-71d944da7f5f admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:53.309206 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-fa394d05-1829-4d51-b92a-71d944da7f5f admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:53.344841 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-fa394d05-1829-4d51-b92a-71d944da7f5f admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.207843 Aug 02 09:08:53.345442 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 35/70] 10.222.0.100 () {60 vars in 1198 bytes} [Tue Aug 2 09:08:53 2022] GET /compute/v2.1/os-services => generated 794 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:08:54.190800 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.191813 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Aug 02 09:08:54.192216 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 36/71] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:54.386764 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-0b6e4f9d-0446-4a32-bec2-8043b1c11221 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:54.389155 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:08:54.389155 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Aug 02 09:08:54.390377 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f9d-0446-4a32-bec2-8043b1c11221 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.390818 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f9d-0446-4a32-bec2-8043b1c11221 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.391600 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f9d-0446-4a32-bec2-8043b1c11221 admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:54.392032 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-0b6e4f9d-0446-4a32-bec2-8043b1c11221 admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:54.411677 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-0b6e4f9d-0446-4a32-bec2-8043b1c11221 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080319 Aug 02 09:08:54.412385 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 36/72] 10.222.0.100 () {60 vars in 1198 bytes} [Tue Aug 2 09:08:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:09:05.708817 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:05.709876 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001480 Aug 02 09:09:05.710277 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 37/73] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:09:05 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:05.864312 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell0:SELECT=4 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:05.865887 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell1:SELECT=4 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:05.866716 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=8 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:09:05.918953 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-5e54f80c-1c96-45cb-bbad-d897d3061397 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:05.921336 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:09:05.921336 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Aug 02 09:09:05.922849 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-5e54f80c-1c96-45cb-bbad-d897d3061397 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:05.923304 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-5e54f80c-1c96-45cb-bbad-d897d3061397 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.924199 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-5e54f80c-1c96-45cb-bbad-d897d3061397 admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:05.924648 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-5e54f80c-1c96-45cb-bbad-d897d3061397 admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:05.951121 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-5e54f80c-1c96-45cb-bbad-d897d3061397 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.091266 Aug 02 09:09:05.951702 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 37/74] 10.222.0.100 () {60 vars in 1198 bytes} [Tue Aug 2 09:09:05 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:09:06.827899 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: DEBUG nova.api.openstack.wsgi [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] Calling method '>' {{(pid=103355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:06.828922 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: INFO nova.api.openstack.requestlog [None req-67195a0d-459a-41cd-9b3f-c9a1b663d36c admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Aug 02 09:09:06.829367 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: [pid: 103355|app: 0|req: 38/75] 10.222.0.100 () {56 vars in 1079 bytes} [Tue Aug 2 09:09:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:09:07.024585 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-acb76674-0b7a-44f4-a2b1-9bf6cab7b475 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:09:07.027090 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:09:07.027090 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Aug 02 09:09:07.028294 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-acb76674-0b7a-44f4-a2b1-9bf6cab7b475 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:07.028758 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-acb76674-0b7a-44f4-a2b1-9bf6cab7b475 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:07.029565 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-acb76674-0b7a-44f4-a2b1-9bf6cab7b475 admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:07.029989 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-acb76674-0b7a-44f4-a2b1-9bf6cab7b475 admin admin] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:07.053611 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-acb76674-0b7a-44f4-a2b1-9bf6cab7b475 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083439 Aug 02 09:09:07.054103 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 38/76] 10.222.0.100 () {60 vars in 1198 bytes} [Tue Aug 2 09:09:06 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:03.305305 dv-cinder-803823-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 09:10:03.305864 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: Tue Aug 2 09:10:03 2022 - graceful shutdown triggered... Aug 02 09:10:03.306306 dv-cinder-803823-15-iscsi devstack@n-api.service[103355]: Gracefully killing worker 1 (pid: 103355)... Aug 02 09:10:03.307665 dv-cinder-803823-15-iscsi devstack@n-api.service[103356]: Gracefully killing worker 2 (pid: 103356)... Aug 02 09:10:04.306575 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: worker 1 buried after 1 seconds Aug 02 09:10:04.306575 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: worker 2 buried after 1 seconds Aug 02 09:10:04.306575 dv-cinder-803823-15-iscsi devstack@n-api.service[103354]: goodbye to uWSGI. Aug 02 09:10:04.308206 dv-cinder-803823-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 09:10:04.308764 dv-cinder-803823-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 09:10:04.311661 dv-cinder-803823-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 09:10:04.323114 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:10:04 2022] *** Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: nodename: dv-cinder-803823-15-iscsi Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: machine: x86_64 Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: clock source: unix Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: pcre jit disabled Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: detected number of CPU cores: 4 Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: current working directory: / Aug 02 09:10:04.325453 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: your processes number limit is 47680 Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: your memory page size is 4096 bytes Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: detected max file descriptor number: 2048 Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: lock engine: pthread robust mutexes Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: thunder lock: enabled Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 09:10:04.326575 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:10:04.369474 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: Python main interpreter initialized at 0x55e3015d69c0 Aug 02 09:10:04.369474 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: python threads support enabled Aug 02 09:10:04.369474 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: your server socket listen backlog is limited to 100 connections Aug 02 09:10:04.369474 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:10:04.369902 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:10:04.369902 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: *** Operational MODE: preforking *** Aug 02 09:10:04.370218 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:10:04.370218 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: spawned uWSGI master process (pid: 117886) Aug 02 09:10:04.370425 dv-cinder-803823-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 09:10:04.377136 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: spawned uWSGI worker 1 (pid: 117908, cores: 1) Aug 02 09:10:04.377136 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: spawned uWSGI worker 2 (pid: 117909, cores: 1) Aug 02 09:10:04.377136 dv-cinder-803823-15-iscsi devstack@n-api.service[117886]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:10:05.059302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:10:05.068939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:10:06.235938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:10:06.235938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: from cryptography.utils import int_from_bytes Aug 02 09:10:06.236655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:10:06.236655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: from cryptography.utils import int_from_bytes Aug 02 09:10:06.251040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:10:06.251040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: from cryptography.utils import int_from_bytes Aug 02 09:10:06.251610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:10:06.251610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: from cryptography.utils import int_from_bytes Aug 02 09:10:08.697992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:10:08.698639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:10:08.698810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:10:08.699181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:10:08.699645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:10:08.700050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.700388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.700718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.701047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.701493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.701813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.702148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.702478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.702819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.703090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.703416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.703747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-15-iscsi {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.704110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.704566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.704889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.705253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.705563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.705894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.706211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.706736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.707193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.707510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.707831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.708182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.709076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.709422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.709758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.710171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.710509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.710825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.711251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-15-iscsi {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.711578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.711899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.712220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.712656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.712979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.713321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.713653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.713982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.714298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.714660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.714986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.715320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.715641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.715953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.716275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.716593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.716920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.717258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.717572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.717829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.718154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.718485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.718811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.719142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.719401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.719657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.720003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.720314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.720626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.720940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.721281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.721603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.721914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.722229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.722544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.722854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.723180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.723507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.723835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.724893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.725792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.725792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.726043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.726365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.726745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.727260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.727385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.727666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.728370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.728370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.728641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.728917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.729255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.729618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.729919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.730175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.730485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.731346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.731346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.731527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.731707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.732018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.732325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.732638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.732955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.733310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.733625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.733936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.734252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.734563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.734876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.735187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.737717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.738026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.738309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.738630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.738941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.739267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.739614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.739931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.740255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.740563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.740879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.741249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.741569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.741879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.742196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.742509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.742813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.743127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.743437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.743747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.744053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.744361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.744693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.745004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.745344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.745660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.745981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.746332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.746668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.747036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.747352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.747691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.748030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.748355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.748677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.749005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.749369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.749688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.750009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.750331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.750658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.750983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.751322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.751651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.751976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.752302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.752621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.752946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.753332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.753638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.753949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.754315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.754665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.755602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.755602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.756118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.756385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.756650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.756930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.757246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.757516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.758289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.758289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.758780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.758780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.759251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.759520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.759760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.759985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.760631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.760631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.760954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.761246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.761572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.761892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.762212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.762525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.762839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.763148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.763465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.763778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.764108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.764377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:10:08.765287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.766151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:10:08.766430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.766430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.766925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:10:08.767166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.767415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:10:08.767667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.769030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:10:08.769354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.769354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.769842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.770088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.770322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.770636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.771806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.772058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.772315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.772559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.772833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.773083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.773354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.774126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.774392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.774654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.774919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.775177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.775435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.775435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.775917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.776231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.776494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.776739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-15-iscsi {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.776973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.776973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.777452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.777676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.777676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.778099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.778720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.779011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.779411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.779675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.779675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.780153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.780390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.780643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.780898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.781167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.781167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.781607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.781870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.782114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.782365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.782602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.782856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.783102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.783348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.783586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.783884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.784496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.784740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.784982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.785303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.785561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.785828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.786081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.786389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.787191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.787447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.787705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.787965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.787965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.788478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-15-iscsi {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.789048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.789371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.789814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.790075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.790338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.790576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.790819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.791109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.791323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.791489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.791661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.791898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.792140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.792395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.792657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.793179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.793422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.793676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.793988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.794721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.794984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.795208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.795453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.795703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.795970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.796232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.796720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.796966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.797270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.797530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.797901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.798141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.798404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.798660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.799374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.799667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.800108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.800356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.800605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.800850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.800850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.801374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.801626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.801890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.802172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.802431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.802682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.802931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.803181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.803423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.803641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.803895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.804132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.804380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.805056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.805349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.805616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.805868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.806121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.806373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.806711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.807056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.807310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.807558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.807803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.808053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.808299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.808550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.808779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.808995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.809177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.809521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.809680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.809851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.810062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.810331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.810485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.810646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.810802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.810956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.811113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.811261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.811417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.811574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.811728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.811882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.811882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.812157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.812309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.812469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.812624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.812768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.812920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.813072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.813277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.813426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.813580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.813732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.813878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.814031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.814031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.814323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.814476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.814620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.814991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.815251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.815251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.815561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.815716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.815861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.816013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.816166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.816166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.816462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.816665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.816818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.816992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.817290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.817452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.817603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.818315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.818467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.818612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.818776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.818930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.819075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.819219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.819591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.819756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.819914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.820060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.820206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.820376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.820672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.820869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.821031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.821201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.821361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.821507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.821661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.821816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.821962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.822113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.822259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.822403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.822549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.822720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.822874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.823115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.823261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.823412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.823565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.823724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.823877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.824029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.824184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.824331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.824475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.824637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.824792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.825206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.825518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.825679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.825834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.825987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.826180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.826339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.826495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.826648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.826854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.827013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.827170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.827442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.827604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.827758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.827910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.828055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.828208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.828367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.828521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.828667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.828819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.828966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.829139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.829326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.829475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.829856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.830019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.830167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.830312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.830470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.830623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.830931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.831086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.831239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.831472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.831629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.831794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.831946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.832092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.832237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.832396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.832542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.832687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.832832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.832832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.833183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.833937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.834093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.834251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:10:08.834397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.834541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.834698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.834852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.834997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.835407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.835710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.835876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.836038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.836192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.836351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.836497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.836663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.836874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.837047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.837220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.837370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.837658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.837821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.837976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.838130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.838284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.838431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.838587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.838753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.838906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.839061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.839213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.839360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.839514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.839671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.839671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.840184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.840333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.840487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.840643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.840789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.840967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.841274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.841440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.841599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.841761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.841908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.842053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.842205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.842922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.843973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.844855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.845190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.845602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.845602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.846068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.846224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.846369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.846516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.846660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.846813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.847026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.849678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.849870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.850274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.850447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.850603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.850603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.850911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.851818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.852420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.852582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.852582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.852886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.853054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.853054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.853442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.853603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.853748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.853893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.854920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.855073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.855228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.855386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.855780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.855952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.856230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.856394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.856541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.856697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.856845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.856998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.857239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.857239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.857570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.857732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.857885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.858979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.859139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.859291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.859466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.859653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.859915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.860080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.860453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.860615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.860782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.860943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.861104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.861104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.861431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.861595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.861595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.861896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.862966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.863262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.863415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.863577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.863739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.863739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.864053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.864206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.864357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.864861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.865217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.865397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.865560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.865967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.866236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.866529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.866697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.866859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.866859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.866859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.867405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.867575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.867575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.867869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.868952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.869142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.869320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.869491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.869654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.869814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.870096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.870271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.870639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.870639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.870956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.871748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.871914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.872097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.872097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.872546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.872707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.872877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.873074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.873295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.873452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.873611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.873772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.873932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.874096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.874249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.874421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.874581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.874761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.875339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.875520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.875520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.875813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.876217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.876403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.876820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.876998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.877187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.877396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.877581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.877740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.877894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.878060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.878216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.878216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.878521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.878675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.878840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.879002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.879155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.879323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.879477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.879647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.880099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.881057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.881057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.881424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.881586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.881799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.882008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.882172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.882327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.882481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.882776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.882950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.883122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.883286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.883447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.883601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.883755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.883921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.884075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.884075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.884075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.884526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.884679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.884840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.885999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.886372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.886535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.886710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.887070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.887241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.887462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.887635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.887798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.887960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.888125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.888289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.888443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.888602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.888758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.888918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.889081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.889300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.889456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.889619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.889805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.890893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.891575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.891751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.891969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.891969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.892281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.892461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.892622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.892775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.892929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.893119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.893371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.893545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.893700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.893857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.893951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.894964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.895084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.895197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.895315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.895427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.895587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.895701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.898120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.898341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.898560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.898778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.898990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.899188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.899387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.899575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.899862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.899862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.900247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.900448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.900644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.900825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.901022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.901533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.907458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.907906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.908163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.908363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.908545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.908745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.908952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.909174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.909385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.909566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.909760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.910680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.910876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.911065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.911265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.911265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.911973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.912180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.912359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.912629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.912810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.912985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.913216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.913409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.913586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.913762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.914014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.914261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.914584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.921477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.922012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.922214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.922214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.922586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.922792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.922792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.923191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.924210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.924413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.924594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.924781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.924958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.925158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.925347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.925548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.925735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.925931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.926115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.926348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.926537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.926537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.926537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.926537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.927270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.927463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.927669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.927847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.928038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.928223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.928515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.928515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.929674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.929874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.930064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.930252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.930439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.930637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.930844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.930844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.931211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.931397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.931582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.931801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.931801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.932503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.932689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.932875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.933058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.933289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.933486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.933669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.933853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.934036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.934217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.934414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.934611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.934805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.934988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.935862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.937674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.938779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.939095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.939322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.940930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.941937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.942009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.942009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.942363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.942363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.942363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.942363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.943973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.944926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.945005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.945078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.946895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.947929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.948929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.949283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.949523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.950365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.950492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.950606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.950732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.950853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.950966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.951849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.952085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.952209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.952606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.952733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.952855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.952968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.953184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.954338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.954494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.954648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.954796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.954950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.955108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.955263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.955415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.955562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.955723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.955883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.956918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.957281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.957432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.957592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.957741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.957897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.957897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.958186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.958411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.959150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.959534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.959805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.959972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.960129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.960311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.960614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.960776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.960951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.961133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.961326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.961632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.961793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.961954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.962118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.962279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.962460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.962824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.962981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.963140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.963304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.963471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.963626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.963788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.963951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.964105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.964259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.964655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.964775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.964925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.965923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.966912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.967976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.968962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.969056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.969232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.969329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.969442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.969799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.969950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.970850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.971954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.972962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.973981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.974969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.975963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.976871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.977983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.978960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.979971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.980995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.981976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.982965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.983911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.984974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.985947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.986874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.987924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.988929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.989804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.990988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.991990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.992933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.993703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.994708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.995739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.996763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.997799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.998297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.998297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.998297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.998614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.998978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.999512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:08.999837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.000186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.000520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.000854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.001220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.001555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.001889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.002204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.002675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.002845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.003137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.003450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.003777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.004096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.004432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.005027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.005925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.006503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.006968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.007298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.007635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.007970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.008292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.008609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.008942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.009281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.009599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.009922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.010241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.010558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.010976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.011297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.011624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.011936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.012252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.012562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.012890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.013223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.013538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.013849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.014167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.014479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.014793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.015099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.015410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.015728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.016038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.016351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.016663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.016981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.017313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.017630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.017996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.018327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.018637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.018949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.019273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.019694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.020024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.020342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.020662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.022004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.022168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.022622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.022966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.023295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.023638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.023975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.024290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.024602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.024912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.025262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.025581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.025899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.026218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.026534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.026850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.027167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.027482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.027797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.028111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.028424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.028736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.029048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.029387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.029701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.030020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.030454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.030784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.031104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.031424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.031745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.032059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.032372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.032696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.033010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.033350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.033681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.034002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.034312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.034741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.035058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.035400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.035701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.036009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.036330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.036682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.036994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.037476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.037794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.038125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.038471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.038805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.039133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.039444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.039755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.040152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.040467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.040796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.041123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.041441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.041750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.042064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.042370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.042678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.043051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.043304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.043614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.043921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.044291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.044530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.044836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.045178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.045474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.045788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.046092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.046403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.046917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.047105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.047405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.047746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.048084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.048342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Registered counter for database nova_api Aug 02 09:10:09.048512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.048712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.049028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.049376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.049691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.050014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.050339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.050667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.050979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.051314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.051622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.051935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.052278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.052759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.053080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.053433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.053761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.054090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.054398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.054725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.055044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.055364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.055682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.055995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.056325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.056638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.056948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.057362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.057677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.057990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.058303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.058615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.058926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.059243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.059653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.059985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.060316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.060627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.060963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.061314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.061667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.062014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.062360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.062690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.063006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.063332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.063638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:10:09.063882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:10:09.074414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.081304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.126180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO dbcounter [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Registered counter for database nova_api Aug 02 09:10:09.139160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.context [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1278ed9-9478-4b17-bf68-714d9637c6d4(cell1) {{(pid=117909) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:10:09.144180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.148795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_db.sqlalchemy.engines [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.148997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.149718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.151798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.153877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Registered counter for database nova_cell0 Aug 02 09:10:09.156225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writer thread running {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.158078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Registered counter for database nova_cell1 Aug 02 09:10:09.165816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.167131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.173952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.175252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.213498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.context [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1278ed9-9478-4b17-bf68-714d9637c6d4(cell1) {{(pid=117908) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:10:09.217624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.219715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.220471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:09.222530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:09.224666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO dbcounter [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Registered counter for database nova_cell0 Aug 02 09:10:09.229003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO dbcounter [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Registered counter for database nova_cell1 Aug 02 09:10:09.237261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_db.sqlalchemy.engines [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.238651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_db.sqlalchemy.engines [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.243992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writer thread running {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.327796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO dbcounter [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Registered counter for database nova_cell0 Aug 02 09:10:09.337748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_db.sqlalchemy.engines [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.343956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writer thread running {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.392817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writer thread running {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.403413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO dbcounter [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Registered counter for database nova_cell0 Aug 02 09:10:09.415002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_db.sqlalchemy.engines [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:10:09.420334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writer thread running {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:10:09.670806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:10:09.678837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:10:09.760108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: WARNING keystonemiddleware.auth_token [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:10:09.767489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: WARNING keystonemiddleware.auth_token [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:10:10.023929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:10:10.030345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: WARNING keystonemiddleware.auth_token [None req-923607f4-a69d-4b6e-9f62-266a5378eeba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:10:10.035967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3015d69c0 pid: 117909 (default app) Aug 02 09:10:10.126515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: WARNING keystonemiddleware.auth_token [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:10:10.133647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: WARNING keystonemiddleware.auth_token [None req-72ff95bc-fd3b-4a6d-82e1-450d1a00e723 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:10:10.139109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3015d69c0 pid: 117908 (default app) Aug 02 09:10:52.571940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.574661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.575898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.576912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.637335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=3 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.638502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=3 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.641103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=3 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:52.642193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=3 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:53.910022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-788b66e7-0a34-4313-8db3-78e5cec063be tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Action: 'create', calling method: .version_select at 0x7f8c19891ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1835874614", "metadata": {"Type": "work"}}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:54.151098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b7f9066-db09-46d0-b2c2-94001f9a695c tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Action: 'create', calling method: .version_select at 0x7f8c19893ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-741475386", "metadata": {"Type": "work"}}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b7f9066-db09-46d0-b2c2-94001f9a695c tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Request method failure captured: Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 121 Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oocsrd9JStW68FkbK4ez1VlpeypUwF3QPMvB2fePg1zAFHrJNFgWACto_YwzqCClTGxcYoJtv9A8LsSM92QEY-_lsOUFg22E5zhWICDwliw4N8Tuw1R5ssTDkIofQAzMaOJg32HTY4JhMPs93uINa17vXPqm_ZLDG-o8RqTWmWHito Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:10:54.170433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e44014cd67e24815b6783a7cebacc760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 173aec63f5b845a9a282ffd4f106bcdb Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-741475386", "metadata": {"Type": "work"}}} Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:10:54.171900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-741475386', 'metadata': {'Type': 'work'}}}} Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:54.173483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:10:54.175642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:10:54.177593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:10:54.177593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.179635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b7f9066-db09-46d0-b2c2-94001f9a695c tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:54.182999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0b7f9066-db09-46d0-b2c2-94001f9a695c tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.549725 Aug 02 09:10:54.185432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1/1] 10.222.0.100 () {60 vars in 1161 bytes} [Tue Aug 2 09:10:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:10:54.202031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1ebf81a-ad90-49cf-9daa-aba846296677 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Action: 'create', calling method: .version_select at 0x7f8c197949d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-835690955", "metadata": {"Type": "work"}}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1ebf81a-ad90-49cf-9daa-aba846296677 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Request method failure captured: Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 119 Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oocsrd9JStW68FkbK4ez1VlpeypUwF3QPMvB2fePg1zAFHrJNFgWACto_YwzqCClTGxcYoJtv9A8LsSM92QEY-_lsOUFg22E5zhWICDwliw4N8Tuw1R5ssTDkIofQAzMaOJg32HTY4JhMPs93uINa17vXPqm_ZLDG-o8RqTWmWHito Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:10:54.210194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e44014cd67e24815b6783a7cebacc760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 173aec63f5b845a9a282ffd4f106bcdb Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-835690955", "metadata": {"Type": "work"}}} Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:10:54.211998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-835690955', 'metadata': {'Type': 'work'}}}} Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi '0' Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:54.212977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:10:54.214391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:10:54.215718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:10:54.215718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.219219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1ebf81a-ad90-49cf-9daa-aba846296677 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:54.220636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c1ebf81a-ad90-49cf-9daa-aba846296677 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029317 Aug 02 09:10:54.222313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2/2] 10.222.0.100 () {60 vars in 1161 bytes} [Tue Aug 2 09:10:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:10:54.233501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e1edbe6-69a2-4a7e-b69f-aacbdbcbfaf6 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Action: 'create', calling method: .version_select at 0x7f8c19766a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2063683524", "metadata": {"Type": "work"}}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e1edbe6-69a2-4a7e-b69f-aacbdbcbfaf6 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Request method failure captured: Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 119 Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oocsrd9JStW68FkbK4ez1VlpeypUwF3QPMvB2fePg1zAFHrJNFgWACto_YwzqCClTGxcYoJtv9A8LsSM92QEY-_lsOUFg22E5zhWICDwliw4N8Tuw1R5ssTDkIofQAzMaOJg32HTY4JhMPs93uINa17vXPqm_ZLDG-o8RqTWmWHito Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:10:54.243519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e44014cd67e24815b6783a7cebacc760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 173aec63f5b845a9a282ffd4f106bcdb Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2063683524", "metadata": {"Type": "work"}}} Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:10:54.244882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2063683524', 'metadata': {'Type': 'work'}}}} Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi '' Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:54.245714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:10:54.249457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:10:54.250640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:10:54.250640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.250640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e1edbe6-69a2-4a7e-b69f-aacbdbcbfaf6 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:54.250640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e1edbe6-69a2-4a7e-b69f-aacbdbcbfaf6 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016130 Aug 02 09:10:54.250640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 3/3] 10.222.0.100 () {60 vars in 1161 bytes} [Tue Aug 2 09:10:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:10:54.262203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3800a7db-5be9-4005-a757-376b8f42be09 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Calling method '.version_select at 0x7f8c19766790>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:54.850834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-3800a7db-5be9-4005-a757-376b8f42be09 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] HTTP exception thrown: Volume tempest-invalid-1377112770 could not be found. Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3800a7db-5be9-4005-a757-376b8f42be09 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Request method failure captured: Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1377112770 HTTP/1.1 Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oocsrd9JStW68FkbK4ez1VlpeypUwF3QPMvB2fePg1zAFHrJNFgWACto_YwzqCClTGxcYoJtv9A8LsSM92QEY-_lsOUFg22E5zhWICDwliw4N8Tuw1R5ssTDkIofQAzMaOJg32HTY4JhMPs93uINa17vXPqm_ZLDG-o8RqTWmWHito Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:10:54.855114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e44014cd67e24815b6783a7cebacc760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 173aec63f5b845a9a282ffd4f106bcdb Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Volume tempest-invalid-1377112770 could not be found. Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'tempest-invalid-1377112770'} Aug 02 09:10:54.857799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1377112770 could not be found. (HTTP 404) (Request-ID: req-7231f8ae-df53-41d0-ba6b-b49c5d9523a3) Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.859233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:54.861311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1377112770 could not be found. Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:54.863895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1377112770 could not be found. Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1377112770 could not be found. Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3800a7db-5be9-4005-a757-376b8f42be09 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Returning 404 to user: Volume tempest-invalid-1377112770 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3800a7db-5be9-4005-a757-376b8f42be09 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1377112770" status: 404 len: 99 microversion: 2.1 time: 0.604047 Aug 02 09:10:54.868832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 4/4] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:10:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1377112770 => generated 99 bytes in 605 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:10:54.873701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff42c33a-f299-4311-89c1-56aa636c67a5 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009412 Aug 02 09:10:54.874952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 5/5] 10.222.0.100 () {58 vars in 1145 bytes} [Tue Aug 2 09:10:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 09:10:54.886829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3f80381a-3181-4579-8b8b-efb3f56b66b2 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004162 Aug 02 09:10:54.887680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 6/6] 10.222.0.100 () {58 vars in 1142 bytes} [Tue Aug 2 09:10:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 09:10:54.918391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae7259eb-d9e2-4eda-bde9-6a6bf4fac105 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Calling method '.version_select at 0x7f8c19699d30>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:55.065693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-ae7259eb-d9e2-4eda-bde9-6a6bf4fac105 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] HTTP exception thrown: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae7259eb-d9e2-4eda-bde9-6a6bf4fac105 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Request method failure captured: Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/os-volumes/476b8f14-2a99-4a35-bad8-ccb970c05e13 HTTP/1.1 Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oocsrd9JStW68FkbK4ez1VlpeypUwF3QPMvB2fePg1zAFHrJNFgWACto_YwzqCClTGxcYoJtv9A8LsSM92QEY-_lsOUFg22E5zhWICDwliw4N8Tuw1R5ssTDkIofQAzMaOJg32HTY4JhMPs93uINa17vXPqm_ZLDG-o8RqTWmWHito Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:10:55.068593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e44014cd67e24815b6783a7cebacc760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 173aec63f5b845a9a282ffd4f106bcdb Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '476b8f14-2a99-4a35-bad8-ccb970c05e13'} Aug 02 09:10:55.071092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. (HTTP 404) (Request-ID: req-96abc68d-7463-451d-a58b-8fb9e84aaeba) Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:55.072693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:55.076271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:10:55.079187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. Aug 02 09:10:55.082263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.084735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae7259eb-d9e2-4eda-bde9-6a6bf4fac105 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Returning 404 to user: Volume 476b8f14-2a99-4a35-bad8-ccb970c05e13 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:55.085909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ae7259eb-d9e2-4eda-bde9-6a6bf4fac105 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/476b8f14-2a99-4a35-bad8-ccb970c05e13" status: 404 len: 109 microversion: 2.1 time: 0.187488 Aug 02 09:10:55.087211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 7/7] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:10:54 2022] DELETE /compute/v2.1/os-volumes/476b8f14-2a99-4a35-bad8-ccb970c05e13 => generated 109 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:55.099328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1cff5013-a5a4-42f6-ab0a-0830766eaba7 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Calling method '.version_select at 0x7f8c19699ca0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:55.212497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-1cff5013-a5a4-42f6-ab0a-0830766eaba7 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] HTTP exception thrown: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1cff5013-a5a4-42f6-ab0a-0830766eaba7 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Request method failure captured: Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/os-volumes/d63053d5-168f-4eda-b8ba-2beaf0a867c1 HTTP/1.1 Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oocsrd9JStW68FkbK4ez1VlpeypUwF3QPMvB2fePg1zAFHrJNFgWACto_YwzqCClTGxcYoJtv9A8LsSM92QEY-_lsOUFg22E5zhWICDwliw4N8Tuw1R5ssTDkIofQAzMaOJg32HTY4JhMPs93uINa17vXPqm_ZLDG-o8RqTWmWHito Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:10:55.217686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e44014cd67e24815b6783a7cebacc760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e44014cd67e24815b6783a7cebacc760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e44014cd67e24815b6783a7cebacc760 Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesNegativeTest-645048984 Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 173aec63f5b845a9a282ffd4f106bcdb Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesNegativeTest-645048984-project Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'd63053d5-168f-4eda-b8ba-2beaf0a867c1'} Aug 02 09:10:55.220327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. (HTTP 404) (Request-ID: req-0349fec0-59b4-488f-94a1-d8669290b053) Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:55.221948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:55.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:10:55.239486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1cff5013-a5a4-42f6-ab0a-0830766eaba7 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] Returning 404 to user: Volume d63053d5-168f-4eda-b8ba-2beaf0a867c1 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1cff5013-a5a4-42f6-ab0a-0830766eaba7 tempest-VolumesNegativeTest-645048984 tempest-VolumesNegativeTest-645048984-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/d63053d5-168f-4eda-b8ba-2beaf0a867c1" status: 404 len: 109 microversion: 2.1 time: 0.139071 Aug 02 09:10:55.241520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 8/8] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:10:55 2022] GET /compute/v2.1/os-volumes/d63053d5-168f-4eda-b8ba-2beaf0a867c1 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:55.665355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-788b66e7-0a34-4313-8db3-78e5cec063be tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.106785 Aug 02 09:10:55.667165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1/9] 10.222.0.100 () {60 vars in 1161 bytes} [Tue Aug 2 09:10:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3111 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 02 09:10:55.686451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8cd1ca8-e154-458d-b3da-b36949f9c29d tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Calling method '.version_select at 0x7f8c19766790>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:55.984639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8cd1ca8-e154-458d-b3da-b36949f9c29d tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848" status: 200 len: 353 microversion: 2.1 time: 0.304863 Aug 02 09:10:55.985245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 9/10] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:10:55 2022] GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 => generated 353 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:57.008916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-34958f9a-5534-48d4-98a4-7f055d081993 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Calling method '.version_select at 0x7f8c19714d30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:57.104995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-34958f9a-5534-48d4-98a4-7f055d081993 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848" status: 200 len: 354 microversion: 2.1 time: 0.108387 Aug 02 09:10:57.105626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 2/11] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:10:56 2022] GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:57.119083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-58272d5e-32f2-4e72-b0b6-3e958766f20b tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Calling method '.version_select at 0x7f8c19699280>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:57.227956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-58272d5e-32f2-4e72-b0b6-3e958766f20b tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848" status: 200 len: 354 microversion: 2.1 time: 0.112834 Aug 02 09:10:57.228404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 10/12] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:10:57 2022] GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:57.251565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-22a3eb5d-4e33-459d-9eb9-d1968c887eda tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Calling method '.version_select at 0x7f8c19725430>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:57.401581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-22a3eb5d-4e33-459d-9eb9-d1968c887eda tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848" status: 202 len: 0 microversion: 2.1 time: 0.154249 Aug 02 09:10:57.402162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 3/13] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:10:57 2022] DELETE /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:10:57.411416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8c6ebcaf-a232-47f5-bb3c-eb26592a33ce tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Calling method '.version_select at 0x7f8c196b3280>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:57.502381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8c6ebcaf-a232-47f5-bb3c-eb26592a33ce tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848" status: 200 len: 353 microversion: 2.1 time: 0.095439 Aug 02 09:10:57.504153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 11/14] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:10:57 2022] GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:58.517398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-427e4f08-6354-4b30-b6a5-d1356ee5e3d1 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Calling method '.version_select at 0x7f8c19725af0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:58.555256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-427e4f08-6354-4b30-b6a5-d1356ee5e3d1 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] HTTP exception thrown: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-427e4f08-6354-4b30-b6a5-d1356ee5e3d1 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Request method failure captured: Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 HTTP/1.1 Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OockMtoPeBkOm5yVrznWX9E2Q0ioDKw551nAhy1OE4TEmUXql_fqfgTVHQUSX_tg86R_b4ZCFlwQM1sN7dXO9HNugDJwwcD_5jS9s1M035MmMGCuw5kNs615b90j4lRwnHS3ci02InACEv8JbTO5SsC9LPTwFv0ZEAGQabtGm6b8EM Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d3b7509951d4beeacd7f741e7db83ba Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesGetTestJSON-315946253 Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:10:58.562897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d3b7509951d4beeacd7f741e7db83ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d3b7509951d4beeacd7f741e7db83ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d3b7509951d4beeacd7f741e7db83ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d3b7509951d4beeacd7f741e7db83ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesGetTestJSON-315946253 Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d3b7509951d4beeacd7f741e7db83ba Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesGetTestJSON-315946253 Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesGetTestJSON-315946253-project Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 9c5e4fd611a746639e1374e641721806 Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesGetTestJSON-315946253-project Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '6411cb32-8bf9-469d-a089-e7cbdf3bd848'} Aug 02 09:10:58.564174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. (HTTP 404) (Request-ID: req-6197eed7-4a1d-44f6-8ad8-608bb73aac82) Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:58.565161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:58.566880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:10:58.571846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. Aug 02 09:10:58.572843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:10:58.577529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-427e4f08-6354-4b30-b6a5-d1356ee5e3d1 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] Returning 404 to user: Volume 6411cb32-8bf9-469d-a089-e7cbdf3bd848 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:58.578519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-427e4f08-6354-4b30-b6a5-d1356ee5e3d1 tempest-VolumesGetTestJSON-315946253 tempest-VolumesGetTestJSON-315946253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848" status: 404 len: 109 microversion: 2.1 time: 0.065111 Aug 02 09:10:58.584744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 4/15] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:10:58 2022] GET /compute/v2.1/os-volumes/6411cb32-8bf9-469d-a089-e7cbdf3bd848 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:11:05.903766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1822523812", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "networks": [{"uuid": "610f6d0c-de2c-4042-8b48-be8091494a2f"}]}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:06.144936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] validate_networks() for [('610f6d0c-de2c-4042-8b48-be8091494a2f', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:09.437148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:09.437814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:09.440089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:09.440605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:09.441805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:09.489317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.490094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.491161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.491789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.557968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Getting quotas for project cde77e494bb54329a58883c255a8c2c0. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:09.567401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Getting quotas for user c2782f4783624ca39ace71143b3b9237 and project cde77e494bb54329a58883c255a8c2c0. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:09.594474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:09.609748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:09.742720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba854325-6684-489f-988e-8fb11199476c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.348444 Aug 02 09:11:09.750449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 12/16] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:11:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 4358 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:11:09.765384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a099a9d9-ea46-4059-86d2-eea79267a83d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:09.766908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a099a9d9-ea46-4059-86d2-eea79267a83d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:10.292649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a099a9d9-ea46-4059-86d2-eea79267a83d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:10.315309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a099a9d9-ea46-4059-86d2-eea79267a83d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1219 microversion: 2.1 time: 0.555557 Aug 02 09:11:10.320590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 5/17] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:09 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1219 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:11.342574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6cff93cf-c524-4fbc-b626-ca71d50c497b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:11.343366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6cff93cf-c524-4fbc-b626-ca71d50c497b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:11.494501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-99c048c8-88ea-41cb-af5b-a2165e0c1a21 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'create', calling method: .version_select at 0x7f8c195a9e50>, body: {"keypair": {"name": "tempest-keypair-1158862248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPldDu6QlgCOYQRLEOcn7ZhKAdd76jX6A2f+AkRFdstone7A48dtxrRN1pNr4Z1qV1UZaZ9M0cR+0rEbDf0jC5drOt5w5xP1wdJfTMqIYR2QP+Lmvn4gS8xd2GWhmdQp9Q=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:11.621046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-99c048c8-88ea-41cb-af5b-a2165e0c1a21 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:11.658176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-99c048c8-88ea-41cb-af5b-a2165e0c1a21 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for user 0e93d159e8644203808918c5ae86fc74 and project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:11.829866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-99c048c8-88ea-41cb-af5b-a2165e0c1a21 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.043898 Aug 02 09:11:11.834631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 13/18] 10.222.0.100 () {62 vars in 1205 bytes} [Tue Aug 2 09:11:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1051 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 09:11:12.609189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6cff93cf-c524-4fbc-b626-ca71d50c497b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:12.618829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6cff93cf-c524-4fbc-b626-ca71d50c497b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1219 microversion: 2.1 time: 1.280916 Aug 02 09:11:12.619412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 6/19] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:11 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1219 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:13.646241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:13.647107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:13.687507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.688221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.689322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.690137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.131406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.173828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2530ac30-0035-4d6e-a533-1d549ed5a532 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1223 microversion: 2.1 time: 0.532311 Aug 02 09:11:14.185096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 14/20] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:13 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1223 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:14.455294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-329071912", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:14.750878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] validate_networks() for [('bdd10181-079c-4c33-b570-aa5043e645f8', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:15.776823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-985812ff-e2ab-496d-8371-04ca70d62b69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: .version_select at 0x7f8c184e73a0>, body: {"keypair": {"name": "tempest-keypair-632376403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwpBxYAqgy5CR7yRNi3bXXT67VrjPG++sLw7D8gaWXBqX4aMST0yXZQLR259ZKRs9DoJyjEmohYyWpcvotGiIZz2+XiMygmWmX1FE00qh7UoRHCN3XyE6/EJL3sR72HuQ=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:15.818640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-985812ff-e2ab-496d-8371-04ca70d62b69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:15.838926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-985812ff-e2ab-496d-8371-04ca70d62b69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:15.906388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-985812ff-e2ab-496d-8371-04ca70d62b69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.741954 Aug 02 09:11:15.924183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 15/21] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:11:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:15.964463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:15.969294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:16.020299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.022266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.024276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.024757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.467651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.493006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d6d79c70-d008-4249-84e2-d0e78ec28b2b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1215 microversion: 2.1 time: 0.566108 Aug 02 09:11:16.502764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 16/22] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:15 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1215 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:17.528719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:17.530543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:17.545159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.553962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.559622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.561038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.173659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.188335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87e5e5df-5ef1-4487-9a6e-f677a0e2ea7b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1277 microversion: 2.1 time: 0.660484 Aug 02 09:11:18.201151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 17/23] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:17 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1277 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:18.867398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1029182357", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73cc5faf-794f-47fb-bcca-7a930b56333e"}], "security_groups": [{"name": "tempest-securitygroup--992774432"}], "key_name": "tempest-keypair-1158862248", "user_data": "}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:19.153577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:19.155451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:19.156581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:19.157608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:19.158606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:19.201077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.201925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.203186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.203789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.299483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:19.320580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for user 6c30f2ab48e74d4690aafe46c4bf682f and project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:19.374707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:19.378645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:19.527478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:19.591907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2857c23a-2c2e-4128-ab71-5775848c2096 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 5.548302 Aug 02 09:11:19.592728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 7/24] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:11:14 2022] POST /compute/v2.1/servers => generated 385 bytes in 5550 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:11:19.598902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:19.603038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] validate_networks() for [('73cc5faf-794f-47fb-bcca-7a930b56333e', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:19.604733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:19.641520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.646537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.648846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.654695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.819123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.898285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-423f6fd5-13d8-43e7-9efe-453cfe667df8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 1.293863 Aug 02 09:11:20.899712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 8/25] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:19 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:20.920989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9d04a477-f6db-4892-9d24-14681b92e6d3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.937016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9d04a477-f6db-4892-9d24-14681b92e6d3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.244221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9d04a477-f6db-4892-9d24-14681b92e6d3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.265364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9d04a477-f6db-4892-9d24-14681b92e6d3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1225 microversion: 2.1 time: 0.363354 Aug 02 09:11:21.266530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 9/26] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1225 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:21.532769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1989541035", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:21.643676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:21.644778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:21.645484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:21.646070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:21.646651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:21.668194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.668794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.673357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.673935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.741710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] validate_networks() for [('bdd10181-079c-4c33-b570-aa5043e645f8', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:21.752239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:21.766978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for user 0e93d159e8644203808918c5ae86fc74 and project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:21.804134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:21.822939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:21.938351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-efc666c0-f3d4-406f-82c2-5ec11f07b902 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 3.080220 Aug 02 09:11:21.941308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 18/27] 10.222.0.100 () {62 vars in 1193 bytes} [Tue Aug 2 09:11:18 2022] POST /compute/v2.1/servers => generated 403 bytes in 3083 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 02 09:11:21.948649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:21.949830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.959682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.960473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.961700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.962491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.599353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:22.619212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0ad65bf-8588-4fdd-8918-6592c1b0acdb tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.676123 Aug 02 09:11:22.645203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 19/28] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:21 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:22.684730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5a6e8f8d-bfc1-4274-a927-d8aeb0ecf943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:22.689913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5a6e8f8d-bfc1-4274-a927-d8aeb0ecf943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.320742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a6e8f8d-bfc1-4274-a927-d8aeb0ecf943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.360944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a6e8f8d-bfc1-4274-a927-d8aeb0ecf943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.369550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a6e8f8d-bfc1-4274-a927-d8aeb0ecf943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.376532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5a6e8f8d-bfc1-4274-a927-d8aeb0ecf943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1286 microversion: 2.20 time: 0.726434 Aug 02 09:11:23.391065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 20/29] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1286 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:23.654397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:23.655558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.691641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.703460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.707277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.708484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.801301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:24.802485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:24.803464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:24.804095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:24.805009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:24.832336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.835785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.838671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.839552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.928069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:24.935941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for user 6c30f2ab48e74d4690aafe46c4bf682f and project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:25.041563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:25.062276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:25.267526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8ed6dd12-7a1a-467d-a182-c37c374d5faf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.739758 Aug 02 09:11:25.275887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 10/30] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:11:21 2022] POST /compute/v2.1/servers => generated 385 bytes in 3743 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:11:25.283981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.286424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.306753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.307763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.311446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.313021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.663010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.663676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.678406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c1df9092-48cd-4b94-83dc-cf94c4a11e40 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 2.030791 Aug 02 09:11:25.701846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.709804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 21/31] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:23 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:25.710851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.712066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-29f3f8d2-ab79-4026-b8c5-270477dcd629 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1338 microversion: 2.20 time: 0.440162 Aug 02 09:11:25.719244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 11/32] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:25.747722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b030b510-edcd-4f72-930b-ab18f5a82953 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.748439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b030b510-edcd-4f72-930b-ab18f5a82953 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.748910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-791706231", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "525d665a-147a-4b35-9ac1-0f68a0b121ae"}], "security_groups": [{"name": "tempest-securitygroup--1925259834"}], "key_name": "tempest-keypair-632376403", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:27.089289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] validate_networks() for [('525d665a-147a-4b35-9ac1-0f68a0b121ae', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:11:27.270985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b030b510-edcd-4f72-930b-ab18f5a82953 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.288944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b030b510-edcd-4f72-930b-ab18f5a82953 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1226 microversion: 2.1 time: 1.571257 Aug 02 09:11:27.293522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 22/33] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1226 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:27.330036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:27.330740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:27.364837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.367063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.373296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.376084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.130430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.145494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-996f6acf-3787-44c8-9385-62ab4445da4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.848151 Aug 02 09:11:28.154591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 23/34] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:27 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:28.156397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.157039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.191825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.208082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.208965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.209528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.888052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.942198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.948153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.963766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c9f04f46-98a1-4bfb-91b7-ae8bcdaedb3f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1344 microversion: 2.20 time: 0.814723 Aug 02 09:11:28.964637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 24/35] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1344 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:29.359812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-a447ba8a-82c9-47b3-ba71-e416dbae39ef req-54a5257d-fd01-4d36-bda1-1aa10b2e8ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad79622-d809-4e0c-b79a-7b7721212540", "tag": "042918b3-1bcd-40e8-8160-372fbde25f8a"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:29.402730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a447ba8a-82c9-47b3-ba71-e416dbae39ef req-54a5257d-fd01-4d36-bda1-1aa10b2e8ac2 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.402985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a447ba8a-82c9-47b3-ba71-e416dbae39ef req-54a5257d-fd01-4d36-bda1-1aa10b2e8ac2 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.487148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-a447ba8a-82c9-47b3-ba71-e416dbae39ef req-54a5257d-fd01-4d36-bda1-1aa10b2e8ac2 service nova] Creating event network-changed:042918b3-1bcd-40e8-8160-372fbde25f8a for instance 9ad79622-d809-4e0c-b79a-7b7721212540 on hv-cinder-80382 Aug 02 09:11:29.489171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a447ba8a-82c9-47b3-ba71-e416dbae39ef req-54a5257d-fd01-4d36-bda1-1aa10b2e8ac2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 09:11:29.493028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.498125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.507177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.508571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.548094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.rpcapi [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 09:11:29.554245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] Releasing lock "compute-rpcapi-router" {{(pid=117908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 09:11:29.618380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b3cd672-25b3-47f3-b349-db0db9d5c36d None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.650243 Aug 02 09:11:29.620631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 25/36] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:29.642048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.645065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.667207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.668052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.671077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.673160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.934996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.948810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ce6ac25-9fd7-4e2a-85c7-1843dbadb826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1284 microversion: 2.1 time: 0.326511 Aug 02 09:11:29.969670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 26/37] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:29.980258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.985023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.996999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.998269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.001065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.004367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.543452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:11:30.544648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:11:30.545204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:11:30.545670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:11:30.546139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:11:30.567666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.568439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.574690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.575459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.628702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:11:30.665160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:11:30.722378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:11:30.732375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:11:30.950818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9e1d4aba-6a7c-40a1-aa2d-7d297b9e48a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 5.230339 Aug 02 09:11:30.959201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 12/38] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:11:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 5239 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:11:30.964645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:30.965523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:30.982458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.983534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.986145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.986950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.568106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.582238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39eb0f0e-55c3-4a93-b88f-3f459b9dade9 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 1.609930 Aug 02 09:11:31.588090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 27/39] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:31.604667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6d65e666-f48f-4eba-87a5-51cac80e2398 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:31.609720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6d65e666-f48f-4eba-87a5-51cac80e2398 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:31.673224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.694076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.699873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.704557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4af65646-e8e9-492a-b888-b4d4a9bf304c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1344 microversion: 2.20 time: 0.743130 Aug 02 09:11:31.705416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 13/40] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1344 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:31.720163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:31.724804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:31.781494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.782144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.783007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.783453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.194071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:32.203030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-afd46fe4-9330-4d13-8fa4-5e8dc11ddefa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1284 microversion: 2.1 time: 0.494209 Aug 02 09:11:32.203614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 14/41] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:31 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1284 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:32.426377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6d65e666-f48f-4eba-87a5-51cac80e2398 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:32.440794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6d65e666-f48f-4eba-87a5-51cac80e2398 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1244 microversion: 2.1 time: 0.850124 Aug 02 09:11:32.444032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 28/42] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1244 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:32.608363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:32.609298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:32.625838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.627413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.630531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.631849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.738444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:32.740206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:32.767788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.768616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.772258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.774530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.801635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:33.843389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-136f2a60-37b8-4d94-92cc-7fe21c1b1306 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 1.238131 Aug 02 09:11:33.852063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 15/43] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:32 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:33.892164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:33.892997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:33.919007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.919470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.926027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:33.941639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.027336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.091711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.099088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.104991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d83b0c94-6ed6-45bb-a070-c1ff0e50f01d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 1.375018 Aug 02 09:11:34.114312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 29/44] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:34.119519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:34.120141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:34.186097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.186543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.188026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.188472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.544642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.559687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5471dc41-f128-41c9-b78c-150730d87056 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1284 microversion: 2.1 time: 0.706147 Aug 02 09:11:34.569464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 16/45] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:33 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1284 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:34.622370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:34.642637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a7744bd7-04a7-4261-a8e0-9a973e2d2dea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1314 microversion: 2.1 time: 0.523835 Aug 02 09:11:34.651597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 30/46] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:34.879815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:34.883254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:34.914590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.917239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.929977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.930932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.151460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:35.152765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:35.178371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.182687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.193058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.195381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.549866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.593140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2484a4c5-09d2-4264-85cc-95d415254748 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.720672 Aug 02 09:11:35.607505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 17/47] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:34 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:35.613937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:35.615004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:35.640454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.641203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.642366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.643027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.644571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.646949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=79 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:35.663150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.665259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.669889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-946b31b4-88a7-4e78-b9a7-65385ca027c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.532688 Aug 02 09:11:35.671299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 31/48] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:35.681479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:35.694202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:35.696178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:35.701878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.702431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.703304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.703818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.860105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.873036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-872e8d8d-4a37-4666-ac64-897fffcb3fd9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1302 microversion: 2.1 time: 0.195364 Aug 02 09:11:35.873739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 32/49] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1302 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:36.091945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-f7d8d765-c91f-44e8-9f3e-98e1d39e2cbd req-962ef64f-0518-462a-b33b-2973ec7b08e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:36.107470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-f7d8d765-c91f-44e8-9f3e-98e1d39e2cbd req-962ef64f-0518-462a-b33b-2973ec7b08e6 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.110085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-f7d8d765-c91f-44e8-9f3e-98e1d39e2cbd req-962ef64f-0518-462a-b33b-2973ec7b08e6 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.134445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-f7d8d765-c91f-44e8-9f3e-98e1d39e2cbd req-962ef64f-0518-462a-b33b-2973ec7b08e6 service nova] Creating event network-changed:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:11:36.141212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-f7d8d765-c91f-44e8-9f3e-98e1d39e2cbd req-962ef64f-0518-462a-b33b-2973ec7b08e6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053258 Aug 02 09:11:36.142114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 33/50] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:36.338026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:36.352682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fa77e057-37e9-427b-9da1-24d21b3d6b56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.743750 Aug 02 09:11:36.353738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 18/51] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:35 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:36.616090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:36.617027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:36.635575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.638687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.645257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.646959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.697138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:36.697871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:36.711057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.711561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.715318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.715854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.906224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:36.926221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f38177ed-0c87-4992-bb69-d2ba15b3dd7e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.315515 Aug 02 09:11:36.927471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 34/52] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:36 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:36.933579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:36.934521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:36.947517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.948597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.949894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.950675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.111638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.120536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40735e5e-30d9-4305-83e3-9aa641a7965e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1302 microversion: 2.1 time: 0.191632 Aug 02 09:11:37.126770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 35/53] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1302 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:37.375188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:37.378018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:37.395359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.396265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.397033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:37.398020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.800994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.819864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d24a9d25-033c-4a6f-a926-1aada19778e2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.448714 Aug 02 09:11:37.820517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 36/54] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:37 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:37.878842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.921912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.928620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.936890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b27832c3-a2a9-41b5-ba56-e874309f4d6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 1.246436 Aug 02 09:11:37.969354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 19/55] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:37.988864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:37.990877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:38.008758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.012599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.013574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.014030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.088947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-fac84f77-9bfc-49d1-b276-369837c15b3c req-2aae89da-57da-4083-89b8-b1f5eb11d677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825f2099-d867-4685-a8b8-2c037bd7d3fd", "tag": "48bebb2e-2ecc-45c9-af36-5a310b8692ff"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:38.107100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-fac84f77-9bfc-49d1-b276-369837c15b3c req-2aae89da-57da-4083-89b8-b1f5eb11d677 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.107929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-fac84f77-9bfc-49d1-b276-369837c15b3c req-2aae89da-57da-4083-89b8-b1f5eb11d677 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.123379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-fac84f77-9bfc-49d1-b276-369837c15b3c req-2aae89da-57da-4083-89b8-b1f5eb11d677 service nova] Creating event network-changed:48bebb2e-2ecc-45c9-af36-5a310b8692ff for instance 825f2099-d867-4685-a8b8-2c037bd7d3fd on hv-cinder-80382 Aug 02 09:11:38.131911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-fac84f77-9bfc-49d1-b276-369837c15b3c req-2aae89da-57da-4083-89b8-b1f5eb11d677 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191580 Aug 02 09:11:38.132719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 37/56] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:38.154536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:38.155564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:38.167700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.168665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.170011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.171129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.662395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:38.671635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6b2ba189-3c34-439c-afaf-16fa60d803da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.525421 Aug 02 09:11:38.692351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 38/57] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:38.785078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:38.794929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c593e01-d546-41ab-b691-a45ac8587629 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.823979 Aug 02 09:11:38.810895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 20/58] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:37 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:38.848141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:38.849421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:38.863974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.864994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.865832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.866282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.987210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:38.987970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:39.003591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.003591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.003591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.003591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.075516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.084775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bc7edf5a-ebcc-45ff-bb98-27706fae8185 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.243224 Aug 02 09:11:39.099620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 39/59] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:38 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:39.214895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.225466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.227066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.228210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-11b5e1cf-f3c7-409a-b5d9-1f2156f6143c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.247417 Aug 02 09:11:39.228913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 21/60] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:39.698271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:39.698803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:39.700899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:39.706419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.706873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.707648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.708091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.820916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:39.821711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:39.823785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:39.829439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.829895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.830901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.831377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.836508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=73 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:39.863034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.870783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9cbcdd53-a3c1-44d4-a9b6-f0775cda77dd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.176417 Aug 02 09:11:39.871377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 40/61] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:39.966552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.974818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d2e584f9-d872-4e92-a0aa-265f83ee59b0 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.157706 Aug 02 09:11:39.975390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 22/62] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:39 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:40.105843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:40.106450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:40.113380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.113823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.114583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.115009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.191902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-5c1af201-ca50-4c2e-b979-7e097cd4648c req-1557e7ec-77ef-4e52-a587-75169789ad69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65316188-d82a-4300-b070-429295684ae2", "tag": "5f2c3b1a-005f-4917-9d01-fa0a98414c5a"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:40.206311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5c1af201-ca50-4c2e-b979-7e097cd4648c req-1557e7ec-77ef-4e52-a587-75169789ad69 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.206762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5c1af201-ca50-4c2e-b979-7e097cd4648c req-1557e7ec-77ef-4e52-a587-75169789ad69 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.227604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-5c1af201-ca50-4c2e-b979-7e097cd4648c req-1557e7ec-77ef-4e52-a587-75169789ad69 service nova] Creating event network-changed:5f2c3b1a-005f-4917-9d01-fa0a98414c5a for instance 65316188-d82a-4300-b070-429295684ae2 on hv-cinder-80382 Aug 02 09:11:40.228149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5c1af201-ca50-4c2e-b979-7e097cd4648c req-1557e7ec-77ef-4e52-a587-75169789ad69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117909) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 09:11:40.229317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.229764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.230565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.230998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.238171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=7 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:40.248836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.compute.rpcapi [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 09:11:40.249775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] Releasing lock "compute-rpcapi-router" {{(pid=117909) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 09:11:40.265592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c8c281dd-5b42-4f24-8d23-7dd9f1c95860 None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079133 Aug 02 09:11:40.266223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 23/63] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:40.271847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:40.272686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:40.279763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.280218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.281001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.281483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.434295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:40.437167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:40.445893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9545e260-6e2a-4f7c-b90e-5f68ea74a206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.343886 Aug 02 09:11:40.446731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 41/64] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:40 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:40.455096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:40.457653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:40.458810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2684de13-2b89-4242-b3ef-9d72f91ae82d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.191450 Aug 02 09:11:40.459379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 24/65] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:40.893894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:40.894665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:40.900522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.900973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.901914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.902223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.996799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:40.997616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:41.000819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=24 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:41.006223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.006831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.007861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.008508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.048956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.064283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df49116d-ee5e-475d-a05a-6db24f8b1459 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.174810 Aug 02 09:11:41.066508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 42/66] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:41.354054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.364962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c57da9c3-6e2a-4162-877b-ee1f2ec43a35 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.371887 Aug 02 09:11:41.365849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 25/67] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:40 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:41.484889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:41.485546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:41.487324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:41.489299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:41.497587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.498045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.499036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.499380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.499648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.499850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.500597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:41.501029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.803165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.813103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.814944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.816185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1af5085c-4504-4ed5-8768-7c1b1b4bda96 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.337362 Aug 02 09:11:41.817150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 26/68] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:41.829982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.840957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-42efd088-7a4d-424c-bd1b-65f6616772b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.376550 Aug 02 09:11:41.841841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 43/69] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:41 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:42.086471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.087353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.094087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.094781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.095759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.096926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.311512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-6f664a18-381a-4677-9414-2861f02fd531 req-1336e8b5-981e-41a1-ae20-2d0744416b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e2d9a6-78b8-4f7a-8216-490f423ba511", "tag": "817289ba-4f88-470b-aec4-8eae8997d6ce"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:42.322680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-6f664a18-381a-4677-9414-2861f02fd531 req-1336e8b5-981e-41a1-ae20-2d0744416b8f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.323126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-6f664a18-381a-4677-9414-2861f02fd531 req-1336e8b5-981e-41a1-ae20-2d0744416b8f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.352919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-6f664a18-381a-4677-9414-2861f02fd531 req-1336e8b5-981e-41a1-ae20-2d0744416b8f service nova] Creating event network-changed:817289ba-4f88-470b-aec4-8eae8997d6ce for instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 on hv-cinder-80382 Aug 02 09:11:42.361054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-6f664a18-381a-4677-9414-2861f02fd531 req-1336e8b5-981e-41a1-ae20-2d0744416b8f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053342 Aug 02 09:11:42.367126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 44/70] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:42.402715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.404979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.423984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.426195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.427478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.435842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.437629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=26 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:42.537673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.556335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b90197e9-bec4-4f63-8201-63ee7b8c15b6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.470978 Aug 02 09:11:42.558324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 27/71] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:42.682429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.698030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4abf89c6-1cd3-4ede-a900-115517b6e908 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.309309 Aug 02 09:11:42.701210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 45/72] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:42.842368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.843227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.851366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.851815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.852601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.853163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.866142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.866913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.875631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.876268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.877347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.877893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.051233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.059413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0158e4f2-fedf-4b60-a927-8f320afa121e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.198552 Aug 02 09:11:43.059923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 46/73] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:43.114964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.122394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.123944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.125090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7b0b9fa-32d6-4fe0-8d28-c8e5e3e3e1f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.287018 Aug 02 09:11:43.125695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 28/74] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:43.580154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:43.581089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:43.587352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.588018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.588798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.589390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.723419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:43.724820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:43.733877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.734623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.735650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.736282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.761561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.773362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5860ca2f-fcba-4783-a128-cb7e04ea23bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.196865 Aug 02 09:11:43.774322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 47/75] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:43.922403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.930943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95f902b1-f8ac-4cf5-bfc6-78b667c9e875 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.213104 Aug 02 09:11:43.931641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 29/76] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:43 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:44.088612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.089416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.095599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.096651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.097461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.097967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.153872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.154992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.167055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.167870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.169295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.170084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.257429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.265443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b1829daf-acbd-4a81-8729-aea1502628f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.181284 Aug 02 09:11:44.266121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 48/77] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:44.322431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.331851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.333480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.334759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-69d772ed-4fb6-4048-bae7-2ceffc143c13 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.189563 Aug 02 09:11:44.335247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 30/78] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:44.796295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.797040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.807524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.813741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.815685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.816263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.950996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.951747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.958221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.958678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.959457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.959895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.027261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.036877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0782b083-eab9-4aef-a7f5-a7f295933e35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.244485 Aug 02 09:11:45.045145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 49/79] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:45.175442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.183469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-44403c9a-51da-4e12-ae9f-b71ae5a1390b tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.236163 Aug 02 09:11:45.184236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 31/80] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:45.288308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:45.289577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:45.296107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.296871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.298241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.298875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.318969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:45.357961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:45.358808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:45.366525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.366983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.367765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.368213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.444247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.452320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-acacb4ad-9d6b-4310-9fe6-d8ef4411e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.168539 Aug 02 09:11:45.453062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 50/81] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:45 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:45.514252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.519405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-06135406-c45b-4932-8ae0-4e962218cc23 req-ab67875e-1180-4f38-9f9c-939ff03e75f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad79622-d809-4e0c-b79a-7b7721212540", "name": "network-vif-plugged", "status": "completed", "tag": "042918b3-1bcd-40e8-8160-372fbde25f8a"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:45.522811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.524357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.525533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-44b647d4-4128-4f6b-99d2-e0e08bc4a06a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.171488 Aug 02 09:11:45.526517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 32/82] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:45.529327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-06135406-c45b-4932-8ae0-4e962218cc23 req-ab67875e-1180-4f38-9f9c-939ff03e75f0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.529770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-06135406-c45b-4932-8ae0-4e962218cc23 req-ab67875e-1180-4f38-9f9c-939ff03e75f0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.541612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-06135406-c45b-4932-8ae0-4e962218cc23 req-ab67875e-1180-4f38-9f9c-939ff03e75f0 service nova] Creating event network-vif-plugged:042918b3-1bcd-40e8-8160-372fbde25f8a for instance 9ad79622-d809-4e0c-b79a-7b7721212540 on hv-cinder-80382 Aug 02 09:11:45.546675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-06135406-c45b-4932-8ae0-4e962218cc23 req-ab67875e-1180-4f38-9f9c-939ff03e75f0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092199 Aug 02 09:11:45.547265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 51/83] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:46.060442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:46.061137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:46.068246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.068702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.069497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.069931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.204282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.207428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:46.208154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:46.212428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40155b6b-1f87-45ee-b50b-6f566c3daaa4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.156099 Aug 02 09:11:46.213007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 33/84] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:46.214624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.215080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.215924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.216368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.348620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.358346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c04925d-06fa-4428-8497-df6421cb2b60 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.156421 Aug 02 09:11:46.358937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 52/85] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:46 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:46.473073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:46.473712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:46.479775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.480220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.480978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.481442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.552472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:46.553344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:46.562711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.563378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.564639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.565846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.632988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.641807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-92ff9fa7-ad4c-47bf-af2f-61632c2a1006 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.172790 Aug 02 09:11:46.642385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 34/86] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:46 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:46.730463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.739109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.740683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.741847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b1e69a1d-cf46-41fd-aeb2-dda2ad4bf0e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.196079 Aug 02 09:11:46.742422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 53/87] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:47.233632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.234250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.240269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.240718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.241507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.241949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.367412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.374842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd62f2b4-f91b-43cf-a86c-de2c2cb7e163 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.145121 Aug 02 09:11:47.375549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 35/88] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:47.379957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.380833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.386945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.387397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.388164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.388607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.528624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.536938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7aa16c9-7df5-42eb-a887-f6a9cad911da tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.160995 Aug 02 09:11:47.537556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 54/89] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:47.664448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.664973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.671016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.671463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.672221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.672657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.764152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.765188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.773413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.773822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.774802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.775038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.808430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.819899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-418d8e38-7664-45aa-bcd6-a518a9421d28 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.159225 Aug 02 09:11:47.820675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 36/90] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:47.944287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.955529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.957085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.958501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d07d6ed1-2b56-4e78-9621-4eeb5198b084 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.198199 Aug 02 09:11:47.959328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 55/91] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:48.397828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.399397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.417852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.418371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.419650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.419650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.561379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.562564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.573315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.574205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.575574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.576380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.609671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.617606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c5cc16ef-4c99-4bea-a127-67ca9b73ad8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.225536 Aug 02 09:11:48.618216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 37/92] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:48.732351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.740158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-15185878-9868-4f7a-a805-0627adb281dc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.185515 Aug 02 09:11:48.740733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 56/93] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:48.854508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.855138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.861882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.862339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.863155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.863696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.983497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.984334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.992902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.993718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.994904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.995354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.027773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.035616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c5f68e02-496d-419e-b7e9-0dbfa881e997 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.185041 Aug 02 09:11:49.036190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 38/94] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:49.128352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.136608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.138162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.139273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-66dd0d36-959d-438b-b47c-7c73439cefa1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.159711 Aug 02 09:11:49.139841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 57/95] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:49.641833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:49.642445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:49.649039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.649520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.650288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.650721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.653351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:49.762761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:49.763370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:49.771665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.772454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.773481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.773925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.792702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.800945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-02a346ba-b4b7-4a96-a94b-8d5ab34f406a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.164234 Aug 02 09:11:49.801577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 39/96] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:49.920418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.928916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fac07ba0-6c03-42bc-b27f-b68306f10dd6 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.170079 Aug 02 09:11:49.929603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 58/97] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:49 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:50.057429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.058221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.065048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.066281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.067072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.067514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.162052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.162892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.169487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.170027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.170879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.171387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.207912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.216942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4daaa1da-2252-4df1-baef-c832d34c6c2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.163179 Aug 02 09:11:50.216942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 40/98] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:50.312853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.321533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.323037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.324136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-be4c5b90-dd07-45b1-9556-c19fc4d8c6c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.166177 Aug 02 09:11:50.324722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 59/99] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:50.821719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.822266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.824037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:50.829296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.829739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.831268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.831663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.951229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.951835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.958627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.959079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.959867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.960309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.962342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:50.970461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-50937eff-07d6-44fb-b976-1ccfb159de76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.152600 Aug 02 09:11:50.971734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 41/100] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:51.102259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.110872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff32bbc5-a7bc-4e64-8fba-f8cb73f05439 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.163743 Aug 02 09:11:51.112717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 60/101] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:51.239152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.239771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:51.245924 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.246407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.247171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.247608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.348778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.349949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:51.360141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.360589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.361465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.362055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.624930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.639138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.641066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.642855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a4d8ce99-3621-4683-b5e2-4b975e35bbda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.298391 Aug 02 09:11:51.644982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 61/102] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:51.679598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.695018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6bad104b-117d-4244-a360-96a4ac933cbc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.458309 Aug 02 09:11:51.705054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 42/103] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:51.992025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.992732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.000278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.001004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.002459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.004316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.133222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.133844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.140360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.153861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.154783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.155227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.192836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.201001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1a023126-3a20-4d75-aa16-8b00c4a4e1da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.212691 Aug 02 09:11:52.201638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 62/104] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:52.638636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.646386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1c4fad3-3010-4e41-a6cd-bad0dcbab5f2 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.517407 Aug 02 09:11:52.647003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 43/105] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:52.671128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.671774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.678436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.678822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.679584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.680020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.720057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.721714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.729630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.730922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.731510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.732786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.866053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.874706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.876681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.878267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a3feb970-83bc-4948-b47f-a0a18c36c99c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.211488 Aug 02 09:11:52.879181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 63/106] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:52.933440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.941521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1ce1619b-777d-4ae0-9382-ba563fd9d417 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.227474 Aug 02 09:11:52.942107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 44/107] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:53.223673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:53.224980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:53.237316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.237773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.238603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.239045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.408671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.419321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba7662c0-78e9-4092-9e00-d839edd3d12a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.198661 Aug 02 09:11:53.430809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 64/108] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:53.668459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:53.669138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:53.669797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-4b9daf8e-26bd-4217-814a-92cbd22cec93 req-0a4a7958-318a-47fa-b371-2cb6187ae0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "name": "network-vif-plugged", "status": "completed", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:53.683465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.684062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.684708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.689217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-4b9daf8e-26bd-4217-814a-92cbd22cec93 req-0a4a7958-318a-47fa-b371-2cb6187ae0ee service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.689623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-4b9daf8e-26bd-4217-814a-92cbd22cec93 req-0a4a7958-318a-47fa-b371-2cb6187ae0ee service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.691364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.723546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-4b9daf8e-26bd-4217-814a-92cbd22cec93 req-0a4a7958-318a-47fa-b371-2cb6187ae0ee service nova] Creating event network-vif-plugged:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:11:53.729757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-4b9daf8e-26bd-4217-814a-92cbd22cec93 req-0a4a7958-318a-47fa-b371-2cb6187ae0ee service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072652 Aug 02 09:11:53.730604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 45/109] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:53.909038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:53.911008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:53.927606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.928271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.937525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.939998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.948790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.974472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e5166acc-89c0-46cb-840a-2c605b8712b5 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1319 microversion: 2.1 time: 0.305652 Aug 02 09:11:53.975158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 65/110] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:53 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:53.993624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:53.994660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:54.010716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.015550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.017103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.018464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.284035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.298401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.302272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.304208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cfb36ead-ad20-4e22-868e-cc5d86977fc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.405979 Aug 02 09:11:54.305379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 46/111] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:54.335073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.344647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8cea6d6f-441b-4738-a525-a56b59ce64f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.367944 Aug 02 09:11:54.357142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 66/112] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:53 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:54.445952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:54.447853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:54.456443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.457102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.458041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:54.458550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:54.669653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:54.684421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a72bc9f4-7ddc-4c6a-aaef-534e3fe76877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.244904 Aug 02 09:11:54.686184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 47/113] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:55.004415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:55.005556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.011716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.012171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.013005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.013469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.169335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.171781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:55.178743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6a964e38-7dc9-4215-b48b-a781c190c978 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1505 microversion: 2.1 time: 0.179719 Aug 02 09:11:55.179324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 67/114] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:54 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:55.328557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:55.329205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.349160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.349160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.349160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.349160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.376063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:55.376698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.395063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.395522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.398931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.402638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.749667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.770110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87c9042f-cf69-435e-8768-c63f67b87271 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.405078 Aug 02 09:11:55.782992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 68/115] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:55 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:55.797789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:55.799431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.806557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.807371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.809445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.810144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.937419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.958562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.964923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.974287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-61e171bb-6b2e-478c-8eb4-3d8a03fc6ec9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.650465 Aug 02 09:11:55.975406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 48/116] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:56.097152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.109679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-912a8216-2d4c-4e81-b1fb-5fe830a44861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.316021 Aug 02 09:11:56.110494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 69/117] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:56.129067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-9ea58ebb-397e-42a8-860a-10c7f2d832fb req-0884a9c9-d5fa-4e7b-9483-f58e7c643a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f2099-d867-4685-a8b8-2c037bd7d3fd", "name": "network-vif-plugged", "status": "completed", "tag": "48bebb2e-2ecc-45c9-af36-5a310b8692ff"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:56.139373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-9ea58ebb-397e-42a8-860a-10c7f2d832fb req-0884a9c9-d5fa-4e7b-9483-f58e7c643a37 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.139825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-9ea58ebb-397e-42a8-860a-10c7f2d832fb req-0884a9c9-d5fa-4e7b-9483-f58e7c643a37 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.152544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-9ea58ebb-397e-42a8-860a-10c7f2d832fb req-0884a9c9-d5fa-4e7b-9483-f58e7c643a37 service nova] Creating event network-vif-plugged:48bebb2e-2ecc-45c9-af36-5a310b8692ff for instance 825f2099-d867-4685-a8b8-2c037bd7d3fd on hv-cinder-80382 Aug 02 09:11:56.158537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-9ea58ebb-397e-42a8-860a-10c7f2d832fb req-0884a9c9-d5fa-4e7b-9483-f58e7c643a37 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Aug 02 09:11:56.159413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 49/118] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:56.795398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:56.796021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:56.804363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.804853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.805791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.806227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.975570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:56.986491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd1ee982-6b1e-40ca-ad2d-ebf809d82e3a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.194880 Aug 02 09:11:56.987266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 70/119] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:56 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:57.001011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:57.002235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:57.010084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.010605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.011520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.012018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.134500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:57.135140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:57.141396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.141844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.144225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:57.144821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:57.147021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.158564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.160660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.161929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c809d8c-959b-4487-88d7-a418b4172c6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.165734 Aug 02 09:11:57.162566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 50/120] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:57.297710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.306268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-16189ede-d9a5-4bb0-bd86-1cc86ad46091 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.175927 Aug 02 09:11:57.306846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 71/121] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:58.008853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.009493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.015503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.015947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.016701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.017148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.156486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.164222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1ee0bf1f-bd96-45fe-849f-53dc1d214c03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.159571 Aug 02 09:11:58.164799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 51/122] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:58.183916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.184551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.191670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.192130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.192899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.193360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.327102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.336247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.337778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.338896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-810f1631-48f0-4665-b674-2e69a230e733 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.159029 Aug 02 09:11:58.339453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 72/123] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:58.340218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.340869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.347067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.347520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.348298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.348738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.484418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.492495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7535626a-d864-4cbb-8c08-d9d56252b842 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.156421 Aug 02 09:11:58.493157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 52/124] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:59.184578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:59.185105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:59.191498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.191943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.192700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.193151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.340462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.349097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-220e643b-9e1b-48e3-831d-ff8ea3b00830 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.168606 Aug 02 09:11:59.349702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 73/125] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:59.362177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:59.362816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:59.368809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.369296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.370070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.370511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.513908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:59.514534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:59.524183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.524642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.525543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.525895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.529845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.539394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.540991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.542408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-246aae25-8baf-492f-94f5-02edc776c51f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.184942 Aug 02 09:11:59.550438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 53/126] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:59.704454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.716467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba4bd15b-4314-4da3-b2da-a9155a6b8763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.206508 Aug 02 09:11:59.727144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 74/127] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:00.227287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "432f2065-b794-490e-a25c-ff216a5aea5b"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:00.230064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.236389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.237294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.238277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.238875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.370755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.371686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.388141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.389061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.390349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.400815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.595366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.614323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0ca31cd6-6eb0-4f8b-a06c-0df30857f074 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.237605 Aug 02 09:12:00.614323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 75/128] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:00 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:00.614323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.614323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.615966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.616612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.617512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.618008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.766999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.776016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.777614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.778724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-98301a4c-df85-43ee-b49f-556b5cd835c4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1411 microversion: 2.20 time: 0.173782 Aug 02 09:12:00.789285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 76/129] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:12:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1411 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:00.789285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.789285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.791770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.792222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.792990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.793460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.938270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:00.947104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b88f88a0-56a7-4283-8e3d-4b66418a63c2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.166046 Aug 02 09:12:00.947883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 77/130] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:01.341033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-b36a0a56-90e0-4ca9-9131-1c23924e4405 req-591c31e1-7f11-4a0d-863f-8118eeb4946e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65316188-d82a-4300-b070-429295684ae2", "name": "network-vif-plugged", "status": "completed", "tag": "5f2c3b1a-005f-4917-9d01-fa0a98414c5a"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:01.353088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b36a0a56-90e0-4ca9-9131-1c23924e4405 req-591c31e1-7f11-4a0d-863f-8118eeb4946e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.353551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b36a0a56-90e0-4ca9-9131-1c23924e4405 req-591c31e1-7f11-4a0d-863f-8118eeb4946e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.365327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-b36a0a56-90e0-4ca9-9131-1c23924e4405 req-591c31e1-7f11-4a0d-863f-8118eeb4946e service nova] Creating event network-vif-plugged:5f2c3b1a-005f-4917-9d01-fa0a98414c5a for instance 65316188-d82a-4300-b070-429295684ae2 on hv-cinder-80382 Aug 02 09:12:01.370568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-b36a0a56-90e0-4ca9-9131-1c23924e4405 req-591c31e1-7f11-4a0d-863f-8118eeb4946e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033218 Aug 02 09:12:01.371419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 78/131] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:01.628946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:01.630132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:01.637348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.637874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.638724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.639223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.777960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.785750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5aed075-ceb4-45ff-8c3c-cd5728801293 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.164301 Aug 02 09:12:01.786316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 79/132] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:01 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:01.803318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:01.803924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:01.809930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.810374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.811145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.811577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.955420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.963705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.965275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.966454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-627e1d38-ff46-4504-9f9b-725a64be88b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1603 microversion: 2.20 time: 0.166886 Aug 02 09:12:01.973977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 80/133] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:12:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1603 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:01.973977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:01.973977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:01.979300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.979754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.980687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:01.981350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.126832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.134740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52628d4c-3514-4c5a-b077-f2dcf29c0a4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.166377 Aug 02 09:12:02.135322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 81/134] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:02.140183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:02.140637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:02.143105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:02.149007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.149589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.150377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.150814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.273684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bb7caa4e-6b21-4153-bd72-2ee4be8eeebb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.137233 Aug 02 09:12:02.274281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 82/135] 10.222.0.100 () {60 vars in 1321 bytes} [Tue Aug 2 09:12:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:12:02.807122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:02.808951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:02.815652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.816368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.817430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.818131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.046115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.054983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-861f6fee-5ce6-418d-96a8-670039d21d6d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.252202 Aug 02 09:12:03.055754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 83/136] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:02 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:03.159815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:03.160662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:03.168489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.168977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.169837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.170304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.319195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.327679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4322ab42-0500-413f-bf07-d60e43974f0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.173429 Aug 02 09:12:03.328479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 84/137] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:03.791916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-96a32945-a0a9-4ee3-b185-462e1d4a4791 req-933a9f79-13d2-4379-8ba3-19dbdcc81ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:03.804855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-96a32945-a0a9-4ee3-b185-462e1d4a4791 req-933a9f79-13d2-4379-8ba3-19dbdcc81ec0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.805583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-96a32945-a0a9-4ee3-b185-462e1d4a4791 req-933a9f79-13d2-4379-8ba3-19dbdcc81ec0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.819970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-96a32945-a0a9-4ee3-b185-462e1d4a4791 req-933a9f79-13d2-4379-8ba3-19dbdcc81ec0 service nova] Creating event network-changed:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:12:03.828110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-96a32945-a0a9-4ee3-b185-462e1d4a4791 req-933a9f79-13d2-4379-8ba3-19dbdcc81ec0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042391 Aug 02 09:12:03.829228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 85/138] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:04.086985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:04.087786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:04.096096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.096545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.098007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.098007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.103332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:04.271496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.281884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-246499dc-124b-474b-9e34-11d84ed2f551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.203263 Aug 02 09:12:04.284430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 86/139] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:04 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:04.349945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:04.350573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:04.356851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.357365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.358125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.358599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.522206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:04.531200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-acb59dd3-ee8b-4f77-87e6-a033e8c129cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.185770 Aug 02 09:12:04.531822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 87/140] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:05.307334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:05.308299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:05.318807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.321940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.322920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.324479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.570502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:05.580872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-594bb8a8-97b7-4e5e-b048-b5625d978d50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.277977 Aug 02 09:12:05.581336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 88/141] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:05 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:05.587271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:05.588115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:05.600300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79e791ef-fba3-4021-95b6-85c07ff5adef tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "POST /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.376760 Aug 02 09:12:05.601144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 54/142] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:12:00 2022] POST /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540/os-volume_attachments => generated 194 bytes in 5378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:05.601960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.602420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.603229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:05.603657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.774169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:05.783517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a41cd8ff-3fcc-4b12-bb01-bb20c9367d88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.200890 Aug 02 09:12:05.784591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 89/143] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:06.604257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:06.605066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:06.635446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:06.635920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.636736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:06.637207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.804966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:06.805633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:06.827081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:06.827833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.852350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:06.853134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.053573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.056468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:07.076173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d380059-68d5-4424-a229-8f165ffcec02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.475879 Aug 02 09:12:07.087428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 55/144] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:06 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:07.128531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:07.141612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-784683bc-c222-4972-82ee-1a8a7c62dfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.339821 Aug 02 09:12:07.150427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 90/145] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:07.155918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-a893aebc-a575-4d42-be99-d6a1d7611add req-682256c0-bba7-4b6f-afa0-767843b08c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e2d9a6-78b8-4f7a-8216-490f423ba511", "name": "network-vif-plugged", "status": "completed", "tag": "817289ba-4f88-470b-aec4-8eae8997d6ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:07.181834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a893aebc-a575-4d42-be99-d6a1d7611add req-682256c0-bba7-4b6f-afa0-767843b08c5d service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.182783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a893aebc-a575-4d42-be99-d6a1d7611add req-682256c0-bba7-4b6f-afa0-767843b08c5d service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.197933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-a893aebc-a575-4d42-be99-d6a1d7611add req-682256c0-bba7-4b6f-afa0-767843b08c5d service nova] Creating event network-vif-plugged:817289ba-4f88-470b-aec4-8eae8997d6ce for instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 on hv-cinder-80382 Aug 02 09:12:07.203063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-a893aebc-a575-4d42-be99-d6a1d7611add req-682256c0-bba7-4b6f-afa0-767843b08c5d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052101 Aug 02 09:12:07.203981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 56/146] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:08.102512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:08.103905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:08.111117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.111822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.112827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.113511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.176771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:08.178973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:08.187218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.188137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.195380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:08.196228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.354017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.367359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-148c6b84-bb7b-4b50-b43e-ec30d1df3cef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1326 microversion: 2.1 time: 0.268666 Aug 02 09:12:08.368267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 91/147] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:08 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1326 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:08.593947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.601044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6111362b-23b0-427c-829a-434292947f34 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.430115 Aug 02 09:12:08.602094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 57/148] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:09.396635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:09.397389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.403862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.404657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.407660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.408485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.631205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:09.638696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.646644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.647092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.648143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.648798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.701479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.710802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ad80684-024f-4801-9c65-8d014a317c77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1519 microversion: 2.1 time: 0.319099 Aug 02 09:12:09.727806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 92/149] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:09 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:09.738886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:09.741554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.749689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.750468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.751493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.752350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.794649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lazy-loading 'flavor' on Instance uuid 65316188-d82a-4300-b070-429295684ae2 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:09.903703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.924872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5a0d2b29-83e4-4df2-8dce-00c56126b44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.303744 Aug 02 09:12:09.927907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 58/150] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:10.002454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0dde92ac-563b-4c50-ac6b-21a43ad7ca29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2/action" status: 200 len: 32 microversion: 2.1 time: 0.272201 Aug 02 09:12:10.003651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 93/151] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:12:09 2022] POST /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:12:10.018548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:10.019240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:10.021423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=74 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:10.030435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.031382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.032270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.033225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.302982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:10.312156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-302d69d8-8b55-4671-a819-a56168cb435b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.302149 Aug 02 09:12:10.312770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 59/152] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:10 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:10.948221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:10.952243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:10.973843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.974054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.999710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:11.000183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.233425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:11.243396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-750c3a55-facd-4f50-b26f-cc5e1b742334 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1370 microversion: 2.1 time: 0.300353 Aug 02 09:12:11.244157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 94/153] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:11.334327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:11.335551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:11.352691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:11.353391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.356068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:11.358525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.552433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:11.569256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-884e300b-2cb1-4f5a-9467-a14ba80fbd73 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.238856 Aug 02 09:12:11.571287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 60/154] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:11 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:12.268014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:12.270647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:12.278159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.278710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.279613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.280713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.449598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.457495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9fea1fe0-430e-46d0-96b8-bc36bccf8233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1560 microversion: 2.1 time: 0.194215 Aug 02 09:12:12.458259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 95/155] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:12.484064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:12.485742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:12.494912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.495957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.497366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.497961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.605418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:12.606325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:12.613710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.614396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.615175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.615599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.640662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf95c30d-6ff7-4fb6-be49-f879b7dc3908 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163547 Aug 02 09:12:12.641319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 61/156] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:12:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:12.976178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1766036307", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:13.024845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.033610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da292e7c-33b5-427f-a277-866c89e9f3b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.432249 Aug 02 09:12:13.046020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 96/157] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:12 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:13.055672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] validate_networks() for None {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:12:13.424756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:12:13.425472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:12:13.426132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:12:13.426547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:12:13.427069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:12:13.437011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.437490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.438286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.439368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.456777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Getting quotas for project 11cb7b53383b4f708c9d508e90072d20. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:13.461825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Getting quotas for user f08fe9a161dd4757a70d4c2075436901 and project 11cb7b53383b4f708c9d508e90072d20. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:13.473740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:12:13.476046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:12:13.523640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88d14bf7-6a42-4f35-bab2-f0ae1120e23d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.551685 Aug 02 09:12:13.524331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 62/158] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:12:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 09:12:13.535969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b172c7f-0dc0-427d-b247-85d2e52eced7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:13.536591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b172c7f-0dc0-427d-b247-85d2e52eced7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:13.630095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b172c7f-0dc0-427d-b247-85d2e52eced7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.640397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b172c7f-0dc0-427d-b247-85d2e52eced7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1219 microversion: 2.1 time: 0.108391 Aug 02 09:12:13.643080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 97/159] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:13 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:14.063365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.064579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.074236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.074930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.076047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.076488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.250000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.262525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-99a60787-c4f7-41dd-8c18-2d39811755fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.204172 Aug 02 09:12:14.263350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 63/160] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:14.396362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-b265001c-7607-41f2-ab23-b3d761b2ef49 req-a1c00634-b43d-4615-a439-2222527913dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e2d9a6-78b8-4f7a-8216-490f423ba511", "tag": "817289ba-4f88-470b-aec4-8eae8997d6ce"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:14.410764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b265001c-7607-41f2-ab23-b3d761b2ef49 req-a1c00634-b43d-4615-a439-2222527913dc service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.411332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b265001c-7607-41f2-ab23-b3d761b2ef49 req-a1c00634-b43d-4615-a439-2222527913dc service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.423571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-b265001c-7607-41f2-ab23-b3d761b2ef49 req-a1c00634-b43d-4615-a439-2222527913dc service nova] Creating event network-changed:817289ba-4f88-470b-aec4-8eae8997d6ce for instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 on hv-cinder-80382 Aug 02 09:12:14.428833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-b265001c-7607-41f2-ab23-b3d761b2ef49 req-a1c00634-b43d-4615-a439-2222527913dc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038855 Aug 02 09:12:14.429402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 98/161] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:14.664061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.665080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.672713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.674167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.675208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.675653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.748775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:14.757179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d38be82d-fd14-489f-9f83-cbafeffa9dfe tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1223 microversion: 2.1 time: 0.097555 Aug 02 09:12:14.757780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 64/162] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:15.291253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:15.292079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:15.299458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.299905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.300693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.301147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.460957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.472316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c8869d5-d1a9-4ff7-a122-b09c4c71a092 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.185274 Aug 02 09:12:15.472821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 99/163] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:15 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:15.778552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:15.779342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:15.788160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.788624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.789740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:15.790276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.858762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.866379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5038f67b-7275-4dc3-8dae-b44122ccaa29 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1223 microversion: 2.1 time: 0.092104 Aug 02 09:12:15.866961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 65/164] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:15 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:16.493881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:16.494488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:16.500631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.501132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.501936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.502372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.641414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:16.649945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4d6321ec-4602-45b3-b83d-bd41ec86fc16 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.160043 Aug 02 09:12:16.650529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 100/165] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:16 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:16.887197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:16.887818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:16.896781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.897185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.898070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.898417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.964077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:16.972461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b5308630-2ff7-4b89-b5d1-0b8978e8b664 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1223 microversion: 2.1 time: 0.089090 Aug 02 09:12:16.974195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 66/166] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:16 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:17.671514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:17.672216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:17.678642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:17.679088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:17.679850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:17.680358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:17.827225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:17.835685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-35228b96-b4f4-4145-957c-bd3539bf2f69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.168181 Aug 02 09:12:17.836308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 101/167] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:17 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:17.994536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:17.995123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:18.002633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.003075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.003925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.005505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.072867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:18.080811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1c4b985-93d3-4dde-bf3b-8be155dd27b8 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1223 microversion: 2.1 time: 0.090066 Aug 02 09:12:18.081426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 67/168] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:17 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:18.855915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:18.856503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:18.863502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.863942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.864707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.865159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.886134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:19.015002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.022890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e270053-3670-4a61-8f5a-c546d4e4540b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.170844 Aug 02 09:12:19.023476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 102/169] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:18 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:19.101596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:19.102543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:19.109174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.109624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.110411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.110845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.172648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.183743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2a04bfd2-dd8d-4368-8e50-8903f4b67115 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1223 microversion: 2.1 time: 0.085975 Aug 02 09:12:19.184324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 68/170] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:19 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:20.046717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.047614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.062222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.062674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.063462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.064534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.207360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.212035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.214720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.217621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11cb4945-0ac1-4769-8a40-6fc32079bde5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.175649 Aug 02 09:12:20.218673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 103/171] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:20 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:20.224224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.224790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.225768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.226278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.294511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.304715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ea5f7995-61d1-4048-8734-208a7810e267 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1215 microversion: 2.1 time: 0.101234 Aug 02 09:12:20.307423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 69/172] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:20 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:20.942384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.942883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.948890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.949380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.950154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.950596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.977510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:12:21.075834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-96d2222f-0a58-4155-a09c-54447824e262 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 204 len: 0 microversion: 2.1 time: 0.138408 Aug 02 09:12:21.076512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 104/173] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:12:20 2022] DELETE /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:12:21.084907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.085560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.092794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.093302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.094095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.094543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.249674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.250910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.258835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.259665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.261297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.261991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.398614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.413655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2b53a60-1b40-474e-81cc-61ab1905901c tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.332129 Aug 02 09:12:21.427175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 70/174] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:21.437034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.437689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.449478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.450331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.451351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.452248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.460088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.468438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2ce44c74-5238-4ccc-96fa-35398d860bc0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.222964 Aug 02 09:12:21.469394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 105/175] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:21.529019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.537941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-75efe209-156f-413b-9bc7-6588e2f587b0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1279 microversion: 2.1 time: 0.109106 Aug 02 09:12:21.538543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 71/176] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:22.435340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.435963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.442902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.443350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.444126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.444563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.495462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.496559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.515947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.516533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.517356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.517788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.602021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.610862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0360652d-775b-4ded-98a5-f9f96a95b8f8 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.178782 Aug 02 09:12:22.611596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 106/177] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:22.617739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.618684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.625314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.626719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.627671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.628102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.661209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.669624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6da3ecfe-5084-4e9a-bdf9-0be9ad19a3c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.182034 Aug 02 09:12:22.670209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 72/178] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:22.699069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:22.707047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-73b68ce6-924c-432e-b6a9-bac49ec4b983 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1279 microversion: 2.1 time: 0.094423 Aug 02 09:12:22.707637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 107/179] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:23.633240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:23.633821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:23.635721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:23.636383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:23.643193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.643640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.644540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.645023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.692156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:23.692778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:23.694801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:23.701285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.701738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.702518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.702954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.799182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:23.811610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98b882bb-889d-4a5b-a56f-719e3f234064 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.181446 Aug 02 09:12:23.812120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 73/180] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:23 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:23.819852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:23.820784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:23.829724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.830698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.832232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:23.834730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:23.839640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:23.870061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:23.887604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fed9cd3e-7c4b-4ebd-91e3-48b637480421 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.200062 Aug 02 09:12:23.888205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 108/181] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:23 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:23.916112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:23.924778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63832d27-7309-46fb-8f29-99c6cba0d6ba tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1279 microversion: 2.1 time: 0.111593 Aug 02 09:12:23.925403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 74/182] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:23 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:24.845549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:24.846325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:24.855552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.856000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.856810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.857249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.927666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:24.928151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:24.934987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.935510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.936548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.937179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.008183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.016663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc1385b6-f36a-4016-b760-2688f172766e tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.175004 Aug 02 09:12:25.017370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 109/183] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:24 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:25.022241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:25.022846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:25.029458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.029899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.030819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.031346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.081464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.089566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2241650e-dc9c-4846-b25c-3bca95d847a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.182922 Aug 02 09:12:25.090198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 75/184] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:24 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:25.100777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.109387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-978ea9d3-39b6-4b69-a40c-d609f371c9fa tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1289 microversion: 2.1 time: 0.090920 Aug 02 09:12:25.109988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 110/185] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:25 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:26.040481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.042419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.049324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.049778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.050565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.050996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.112234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.113021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.119520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.120073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.120918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.121574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.227070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.236529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d6f67b54-c939-43ca-865e-6bc2a58c29e7 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.201929 Aug 02 09:12:26.237509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 76/186] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:26 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:26.242735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.243567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.250316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.251709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.252999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.253627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.286149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.293147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-053441b0-16cb-4709-9ea9-5a1c45fadf63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.185874 Aug 02 09:12:26.293743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 111/187] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:26 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:26.334510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.342962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-527f9309-1844-46f6-a0e2-159bb08537a5 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1289 microversion: 2.1 time: 0.104094 Aug 02 09:12:26.343549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 77/188] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:26 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:27.263067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:27.265101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:27.275386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.276169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.277349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.278046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.319522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:27.320345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:27.334267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.334730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.337307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.337763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.472471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.484678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8feb0fa5-41aa-4cf3-88e3-150a6f6abcc3 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.228171 Aug 02 09:12:27.485679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 112/189] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:27 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:27.492164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:27.493017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:27.501597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.502326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.503539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.504157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.582465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.590492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2207d996-eae4-4473-b4dc-112c0658b4b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1277 microversion: 2.1 time: 0.102952 Aug 02 09:12:27.591398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 113/190] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:27 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:27.920575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.929291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9340448b-ba22-437f-8a04-4259ef5ad3f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.616329 Aug 02 09:12:27.930104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 78/191] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:27 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:28.511449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.512285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.521209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.521882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.522834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.523796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.615107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.616060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.623422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.624225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.625037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.626369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.734989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.743511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-70be07e5-06f1-4dd6-a5d4-9f5999a8d348 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.238861 Aug 02 09:12:28.758139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 114/192] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:28.805280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.818759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-68a6af58-2632-4a6e-97d6-132fec05c653 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.207645 Aug 02 09:12:28.819354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 79/193] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:28.951551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.952195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.959451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.959899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.960668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.961129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.102050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:29.111319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1513340b-975f-4455-9a7e-2c6cc4bbf57e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.163979 Aug 02 09:12:29.112576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 115/194] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:29.766269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:29.767239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:29.774301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.774761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.775523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.776057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.839943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:29.840562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:29.848293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.848889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.850023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.850624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.933577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:29.942640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c154195a-b0af-42f0-94f0-d17353e9dccc tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.180366 Aug 02 09:12:29.943281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 80/195] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:29 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:30.027464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:30.039184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bc2e6172-ec4f-41fd-a98a-3438b3eb5a98 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.203049 Aug 02 09:12:30.040437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 116/196] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:29 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:30.134614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:30.135239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:30.141866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.142335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.143150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.143588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.287502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:30.295176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-04e0b5c6-55af-4d40-bad9-9b62bdd9b324 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.164781 Aug 02 09:12:30.295752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 81/197] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:30 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:30.966984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:30.967642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:30.974749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.975200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.975987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:30.976434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.993296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:31.063901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:31.065738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:31.073476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.074704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.076370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.077458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.160995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.170822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4dc51c3c-49b9-4528-896e-89db08ca2f9f tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1557 microversion: 2.1 time: 0.207665 Aug 02 09:12:31.171421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 117/198] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:30 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:31.317744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:31.318465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:31.324924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.325553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.326810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.327197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.490328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.498328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2962a809-9b85-4279-b00a-1ae4105cd16b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.185840 Aug 02 09:12:31.499019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 118/199] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:31 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:31.538216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.556591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a4f0fff7-9838-4f82-b4e3-767ad044dc83 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.497525 Aug 02 09:12:31.557288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 82/200] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:31 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:31.884739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-b3084694-8e0d-4dbf-9604-e0d1fdd12d55 req-97b50695-a8c2-4fb2-98bb-378365a5570b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad79622-d809-4e0c-b79a-7b7721212540", "name": "network-vif-deleted", "tag": "042918b3-1bcd-40e8-8160-372fbde25f8a"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:31.898962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b3084694-8e0d-4dbf-9604-e0d1fdd12d55 req-97b50695-a8c2-4fb2-98bb-378365a5570b service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.899671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b3084694-8e0d-4dbf-9604-e0d1fdd12d55 req-97b50695-a8c2-4fb2-98bb-378365a5570b service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.914097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-b3084694-8e0d-4dbf-9604-e0d1fdd12d55 req-97b50695-a8c2-4fb2-98bb-378365a5570b service nova] Creating event network-vif-deleted:042918b3-1bcd-40e8-8160-372fbde25f8a for instance 9ad79622-d809-4e0c-b79a-7b7721212540 on hv-cinder-80382 Aug 02 09:12:31.922232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-b3084694-8e0d-4dbf-9604-e0d1fdd12d55 req-97b50695-a8c2-4fb2-98bb-378365a5570b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041502 Aug 02 09:12:31.924172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 119/201] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:32.193774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:32.194407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.205759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.206209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.207012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.207614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.284337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:32.294773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d6a94c78-7bf9-4770-80b0-0cb3e2473268 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1350 microversion: 2.1 time: 0.106731 Aug 02 09:12:32.295509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 83/202] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:32 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:32.520487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:32.521221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.523359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:32.528980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.529453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.530230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.530661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.578739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:32.579364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.585975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.586428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.587212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.587760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.702430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:32.715310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0bd39204-3241-4808-8e2f-c0bf5896a355 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.198986 Aug 02 09:12:32.715913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 120/203] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:32 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:32.759624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:32.768749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13dd7206-aab5-4d57-99be-d5a61b2bc19a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.193847 Aug 02 09:12:32.769368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 84/204] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:32 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:33.316099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:33.316624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:33.322825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.323284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.324054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.324493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.356105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.356556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.357011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lazy-loading 'fault' on Instance uuid 9ad79622-d809-4e0c-b79a-7b7721212540 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:33.402788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.412020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-415e3557-b069-45d0-8523-fe7886134850 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1355 microversion: 2.1 time: 0.099866 Aug 02 09:12:33.412601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 121/205] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:33 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:33.736812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:33.737381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:33.743936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.744373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.745157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.745590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.795049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:33.795668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:33.802461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.802899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.803670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.804098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.890598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.899217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d08c88c4-ec87-4bbf-b8e2-e23803a2f708 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.166541 Aug 02 09:12:33.899794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 85/206] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:33 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:33.940251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.947633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8ca2f4fa-ec7f-4627-8ad2-ba5187f0079d tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.156445 Aug 02 09:12:33.948210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 122/207] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:33 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:33.963697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-98afb254-b8cd-446b-a208-79f619999c27 req-d01b77fd-3c51-4f83-82e4-8ac34849d06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f06b37-3303-42f6-b022-bc82de08102b", "tag": "6d621682-10ee-47df-9acd-89fc4e817d6b"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:33.976207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-98afb254-b8cd-446b-a208-79f619999c27 req-d01b77fd-3c51-4f83-82e4-8ac34849d06c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.976644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-98afb254-b8cd-446b-a208-79f619999c27 req-d01b77fd-3c51-4f83-82e4-8ac34849d06c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.988200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-98afb254-b8cd-446b-a208-79f619999c27 req-d01b77fd-3c51-4f83-82e4-8ac34849d06c service nova] Creating event network-changed:6d621682-10ee-47df-9acd-89fc4e817d6b for instance 34f06b37-3303-42f6-b022-bc82de08102b on hv-cinder-80382 Aug 02 09:12:33.993379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-98afb254-b8cd-446b-a208-79f619999c27 req-d01b77fd-3c51-4f83-82e4-8ac34849d06c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034170 Aug 02 09:12:33.993972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 86/208] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:34.435629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:34.436246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:34.445368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.445822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.446607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.447042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.480051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.480051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.480051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lazy-loading 'fault' on Instance uuid 9ad79622-d809-4e0c-b79a-7b7721212540 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:34.529555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:34.538529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54d0bad9-fae3-4603-b69b-55e1183fdf53 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1355 microversion: 2.1 time: 0.106950 Aug 02 09:12:34.539114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 123/209] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:34 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:34.923218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:34.924006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:34.930285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.930739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.931517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.931954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.969897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:34.971577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:34.978552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.979388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.980512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.981503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.077830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.086016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-108de73a-8a89-472d-b4c5-45df9fcc627c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.168786 Aug 02 09:12:35.086600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 87/210] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:34 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:35.117811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.125717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-10d51947-70bd-4a56-8542-f0380f299d44 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.160111 Aug 02 09:12:35.126422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 124/211] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:34 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:35.559833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:35.560450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:35.567033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.567484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.568253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.568695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.602048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.602407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.602868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lazy-loading 'fault' on Instance uuid 9ad79622-d809-4e0c-b79a-7b7721212540 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:35.648173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.656155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dca54b1c-314e-4bdc-b12d-8791d20b5484 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1355 microversion: 2.1 time: 0.100157 Aug 02 09:12:35.656729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 88/212] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:35 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:36.107893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.108501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.115320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.115753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.116521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.116960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.148164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.148787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.156558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.157018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.157908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.158349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.259114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:36.266878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b1baf8d-be06-4072-89e2-b8f2237c5664 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.162781 Aug 02 09:12:36.267663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 125/213] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:36.305871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:36.313391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4523320c-7df4-476f-9f8f-0b4827483a23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.169713 Aug 02 09:12:36.313965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 89/214] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:36.677877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.678235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.685627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.686158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.687073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.687581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.721705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.722191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.722639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lazy-loading 'fault' on Instance uuid 9ad79622-d809-4e0c-b79a-7b7721212540 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:36.769101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2782f4783624ca39ace71143b3b9237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde77e494bb54329a58883c255a8c2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:36.777473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0222d8de-45c8-466e-834e-246f36222689 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 200 len: 1355 microversion: 2.1 time: 0.103846 Aug 02 09:12:36.778067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 126/215] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:37.287668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.288286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.296249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.296710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.297517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.297955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.335338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.335956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.342285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.342746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.343547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.343996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.457228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.477405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-570346a9-c6e8-4979-9482-ad96a0a79bce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.193403 Aug 02 09:12:37.478601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 90/216] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:37.497410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.506056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8ba52761-88ff-4bdc-9e0d-af350d065e23 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.174459 Aug 02 09:12:37.506647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 127/217] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:37.802345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.803117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.809338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.809954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.810788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.811327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.814365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:37.826659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] HTTP exception thrown: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Request method failure captured: Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 HTTP/1.1 Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooo46uL8koOO3bGpQdXqiEaTlqn2FFWRPVmq282Tz2OkFA1Trl_RxEkfmDZ9aaZn39ZXS77IL5iPYbLxUrOmBRnBINuUBMvcaGJ1jWvuSAnFa0zWW3TEFXpcZtoQteQYX4Ip93wtJ3sUO7Z0J710kTh5RmQ2hbTOIpJ48gSdoW4aZM Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:12:37.832184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c2782f4783624ca39ace71143b3b9237 Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.833704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '9ad79622-d809-4e0c-b79a-7b7721212540'} Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:12:37.834573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.839028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.840197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Returning 404 to user: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:12:37.840197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a5e16a05-35b7-46b3-93c9-19b32ee2b283 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 404 len: 111 microversion: 2.1 time: 0.037939 Aug 02 09:12:37.840197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 91/218] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:12:37.962617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.964875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.971757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.972604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.973455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.973895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.988257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] HTTP exception thrown: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Request method failure captured: Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540/os-volume_attachments HTTP/1.1 Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooo46uL8koOO3bGpQdXqiEaTlqn2FFWRPVmq282Tz2OkFA1Trl_RxEkfmDZ9aaZn39ZXS77IL5iPYbLxUrOmBRnBINuUBMvcaGJ1jWvuSAnFa0zWW3TEFXpcZtoQteQYX4Ip93wtJ3sUO7Z0J710kTh5RmQ2hbTOIpJ48gSdoW4aZM Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:12:37.992469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c2782f4783624ca39ace71143b3b9237 Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.994072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '9ad79622-d809-4e0c-b79a-7b7721212540'} Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:12:37.995492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:37.998005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:38.000260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Returning 404 to user: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:12:38.000260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e79f6ec7-0e70-46d1-8ea7-358770fef352 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035428 Aug 02 09:12:38.000260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 128/219] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:12:38.499675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:38.500977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:38.509897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.510352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.511165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.512991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.538444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:38.539069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:38.546687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.548457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.549761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.550523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.709548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.722765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bde51e94-a963-4c53-b00b-e921595cadd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.226377 Aug 02 09:12:38.723896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 92/220] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:38 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:38.734910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.753181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0e447ded-4a80-4a0c-8882-939175cae8a0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.218529 Aug 02 09:12:38.754246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 129/221] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:38 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:39.221877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.222436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.229027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.230146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.230960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.231396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.246028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] HTTP exception thrown: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Request method failure captured: Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 HTTP/1.1 Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooo46uL8koOO3bGpQdXqiEaTlqn2FFWRPVmq282Tz2OkFA1Trl_RxEkfmDZ9aaZn39ZXS77IL5iPYbLxUrOmBRnBINuUBMvcaGJ1jWvuSAnFa0zWW3TEFXpcZtoQteQYX4Ip93wtJ3sUO7Z0J710kTh5RmQ2hbTOIpJ48gSdoW4aZM Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:12:39.247589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c2782f4783624ca39ace71143b3b9237 Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.248765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '9ad79622-d809-4e0c-b79a-7b7721212540'} Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:12:39.249442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.250457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.251487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Returning 404 to user: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:12:39.251487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87c92eb9-c1a1-4f3c-98de-c0580efdca4d tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 404 len: 111 microversion: 2.1 time: 0.031838 Aug 02 09:12:39.251487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 93/222] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:12:39 2022] DELETE /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:12:39.258428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.259039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] [instance: 9ad79622-d809-4e0c-b79a-7b7721212540] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.265316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.265812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.266744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.267172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.282656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] HTTP exception thrown: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Request method failure captured: Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 HTTP/1.1 Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooo46uL8koOO3bGpQdXqiEaTlqn2FFWRPVmq282Tz2OkFA1Trl_RxEkfmDZ9aaZn39ZXS77IL5iPYbLxUrOmBRnBINuUBMvcaGJ1jWvuSAnFa0zWW3TEFXpcZtoQteQYX4Ip93wtJ3sUO7Z0J710kTh5RmQ2hbTOIpJ48gSdoW4aZM Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:12:39.284489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/cde77e494bb54329a58883c255a8c2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: cde77e494bb54329a58883c255a8c2c0 Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-DeleteServersTestJSON-2043825405 Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c2782f4783624ca39ace71143b3b9237 Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-DeleteServersTestJSON-2043825405-project Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.285896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '9ad79622-d809-4e0c-b79a-7b7721212540'} Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:12:39.286644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. Aug 02 09:12:39.287758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:12:39.288716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] Returning 404 to user: Instance 9ad79622-d809-4e0c-b79a-7b7721212540 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:12:39.288716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dc34b8e-4aee-42aa-ba23-2e9d392d8f72 tempest-DeleteServersTestJSON-2043825405 tempest-DeleteServersTestJSON-2043825405-project] 10.222.0.100 "GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540" status: 404 len: 111 microversion: 2.1 time: 0.031881 Aug 02 09:12:39.288716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 130/223] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/9ad79622-d809-4e0c-b79a-7b7721212540 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:12:39.748238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.748852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.756181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.756713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.757529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.757956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.775961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.778017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.786359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.787553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.788904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.789573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.913756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:39.921666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-501a2958-7c15-4a59-ac05-70107b42312b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.177555 Aug 02 09:12:39.927902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 94/224] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:40.076926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.085481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-300d4b13-d832-4056-ba75-8f99ab8e322b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.313289 Aug 02 09:12:40.086093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 131/225] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:40.959186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:40.961026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:40.970301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:40.974075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.975028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.976774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.977508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.111151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:41.111881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:41.120844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.121436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.122285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.122785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.148533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.163456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7d116643-9aed-45c2-892a-966c42194ba9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.221395 Aug 02 09:12:41.166824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 95/226] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:40 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:41.383437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.395115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2bd96dbf-4a95-43d9-bbdf-fc6f95aae177 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.288384 Aug 02 09:12:41.395706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 132/227] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:41 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:42.186646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:42.187253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:42.194583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.195034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.195799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.196233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.345055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:42.353184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2bbcda44-0846-4133-a0cc-1b470386e61c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.170443 Aug 02 09:12:42.354123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 96/228] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:42 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:42.416571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:42.417265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:42.424217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.428860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.429868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.430354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.684045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:42.694915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7ebc3fb-a7fc-4829-b62b-78108428b451 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.282457 Aug 02 09:12:42.709171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 133/229] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:42 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:43.377544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:43.378269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:43.385434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.387182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.388245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.388851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.539908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.548809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f5861654-3992-44a1-affa-8e7fb3cee302 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.175929 Aug 02 09:12:43.549433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 97/230] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:43 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:43.716032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:43.716659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:43.723544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.723994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.724774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.725253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.905421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.917075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-98505759-3901-42df-a7cd-d6e7e8609758 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.204993 Aug 02 09:12:43.917924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 134/231] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:43 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:44.575675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:44.576598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:44.584149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.584910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.587360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.588218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.810252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:44.820055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8fecb724-1d2b-4739-9952-55f7ed335165 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.251866 Aug 02 09:12:44.820751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 98/232] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:44 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:44.944055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:44.944813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:44.954926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.956042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.960214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.961397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.973640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:45.080980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-77df8ff9-1626-4388-b340-0836e6818d35 req-dea4fccc-bb95-4978-ae78-9ec9d79ed672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f06b37-3303-42f6-b022-bc82de08102b", "name": "network-vif-plugged", "status": "completed", "tag": "6d621682-10ee-47df-9acd-89fc4e817d6b"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:45.109092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-77df8ff9-1626-4388-b340-0836e6818d35 req-dea4fccc-bb95-4978-ae78-9ec9d79ed672 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.110034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-77df8ff9-1626-4388-b340-0836e6818d35 req-dea4fccc-bb95-4978-ae78-9ec9d79ed672 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.123352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-77df8ff9-1626-4388-b340-0836e6818d35 req-dea4fccc-bb95-4978-ae78-9ec9d79ed672 service nova] Creating event network-vif-plugged:6d621682-10ee-47df-9acd-89fc4e817d6b for instance 34f06b37-3303-42f6-b022-bc82de08102b on hv-cinder-80382 Aug 02 09:12:45.129176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-77df8ff9-1626-4388-b340-0836e6818d35 req-dea4fccc-bb95-4978-ae78-9ec9d79ed672 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052953 Aug 02 09:12:45.130053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 99/233] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:45.279620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.289786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87e70327-4a19-4457-bd4c-2e81c43b96b7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.349512 Aug 02 09:12:45.290661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 135/234] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:44 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:45.851809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:45.853150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:45.868575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.869384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.871151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.871786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.316765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:46.317950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:46.340912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:46.345654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.346107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.346962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.347437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.352500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3c954dd6-6d7e-4f45-94de-a115497c5195 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1525 microversion: 2.1 time: 0.513301 Aug 02 09:12:46.354608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 100/235] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:45 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1525 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:46.655323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:46.665808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8d2edce0-9b33-4ba3-b76c-85764fbb4911 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.354135 Aug 02 09:12:46.666746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 136/236] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:46 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:47.379171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:47.380034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:47.388712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.389189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.389981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.392147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.559579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.569537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e5a34e79-dbc8-48b7-87df-520e5fd32bdd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1505 microversion: 2.1 time: 0.196656 Aug 02 09:12:47.570556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 101/237] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:47 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:47.590240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:47.590869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:47.598010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.598459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.599243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.599683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.688278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:47.688995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:47.696020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.696404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.697977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.698602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.840172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.853785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc9283c8-44da-4e61-b9d0-1fd158a64b93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1517 microversion: 2.1 time: 0.266920 Aug 02 09:12:47.855215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 137/238] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:47 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:47.863353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.871708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95ba5af6-c92b-42d6-ac07-6b984da5c3b3 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.188010 Aug 02 09:12:47.872614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 102/239] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:47 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:48.894985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:48.895692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:48.902170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:48.904035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:48.904967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:48.905507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:49.091194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:49.105947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5fdd82f-f336-4652-a43c-f6996b379674 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.214534 Aug 02 09:12:49.120694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 138/240] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:48 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:50.129334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:50.130131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:50.137202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:50.138045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:50.139024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:50.139568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:50.304604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.305972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2766b265-17dd-4a17-8758-b5b533ce1eb4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: .version_select at 0x7f8c18276ee0>, body: {"keypair": {"name": "tempest-keypair-685715602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWMJ3CJvQLFsXfWDNvzCZGpY7vqzV6lFG56irQTVgSfNYqJOK3QyIdBcHHBJQyMSZtFHkJoJEWjT3GLxnpv3598Xm5hMuSPNUfHzXyGaIqzNQtPneZ5/iKYps6G4rXDwQ=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:50.313179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-389fae43-58ac-4124-9094-bc2f8afd918b tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.188436 Aug 02 09:12:50.313738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 139/241] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:50 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:50.329249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-2766b265-17dd-4a17-8758-b5b533ce1eb4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for project e2757dae0d3a45a29427faed00e98996. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:50.333932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-2766b265-17dd-4a17-8758-b5b533ce1eb4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for user 18728d1c3451497480556461b4ec80d5 and project e2757dae0d3a45a29427faed00e98996. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:50.375378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2766b265-17dd-4a17-8758-b5b533ce1eb4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267771 Aug 02 09:12:50.378333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 103/242] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:12:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:51.335833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:51.336768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:51.346442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:51.347121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:51.348015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:51.348559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:51.536928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.555211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-42db42d9-9801-4ad0-ada0-1e6c88642d69 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.223446 Aug 02 09:12:51.556561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 140/243] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:51 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:51.858309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1979600642", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec67370-da38-4647-aa65-37564a860afd"}], "security_groups": [{"name": "tempest-securitygroup--31653621"}], "key_name": "tempest-keypair-685715602", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:51.972508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] validate_networks() for [('fec67370-da38-4647-aa65-37564a860afd', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:12:52.399044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:12:52.399496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:12:52.399999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:12:52.400417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:12:52.400809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:12:52.410962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.411586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.412396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.412832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.430636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for project e2757dae0d3a45a29427faed00e98996. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:52.435171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for user 18728d1c3451497480556461b4ec80d5 and project e2757dae0d3a45a29427faed00e98996. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:52.446931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:12:52.449213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:12:52.509127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4d6aa36a-2f14-46a1-a7bb-4b73c4e1f9a3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655811 Aug 02 09:12:52.510067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 104/244] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:12:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 09:12:52.522763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-38d46eef-1d5d-4503-930b-3dfba68fd3ac tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:52.524690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-38d46eef-1d5d-4503-930b-3dfba68fd3ac tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:52.591459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:52.592099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:52.600096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.600847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.601880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.602621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.674344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-38d46eef-1d5d-4503-930b-3dfba68fd3ac tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:52.690665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-38d46eef-1d5d-4503-930b-3dfba68fd3ac tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1241 microversion: 2.1 time: 0.173515 Aug 02 09:12:52.691270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 141/245] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:52 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:52.771968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:52.780281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:52.812904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.815167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.816426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.816882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.868284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lazy-loading 'flavor' on Instance uuid 825f2099-d867-4685-a8b8-2c037bd7d3fd {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:52.932702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:52.946413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66e9cd9b-4ea8-42be-a8eb-7dd35e3ce9ee tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1319 microversion: 2.1 time: 0.363333 Aug 02 09:12:52.948970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 105/246] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:52 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:53.027397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4c708b1e-aba6-4211-a0d2-31f8dda3e7a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/action" status: 200 len: 32 microversion: 2.1 time: 0.291618 Aug 02 09:12:53.028654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 142/247] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:12:52 2022] POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:12:53.040147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:53.040774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:53.049890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.050321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.051398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.051832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.306433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:53.317727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cab0a414-6058-48cd-9f75-8ec34b11b95f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.282664 Aug 02 09:12:53.318941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 106/248] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:53 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:53.719550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:53.720461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:53.733664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.734662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.735927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.736642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.827429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:53.836073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ea888d3-3f54-4f73-ab1c-e4dbfbea9ea4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1293 microversion: 2.1 time: 0.123358 Aug 02 09:12:53.836682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 143/249] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:53 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:53.969446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:53.970708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:53.978134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.978606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.979835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.980491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.186738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:54.200464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eae7a106-e435-40eb-a83e-254326c471bf tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1469 microversion: 2.1 time: 0.235029 Aug 02 09:12:54.214068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 107/250] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:53 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:54.258438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:54.259197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:54.265901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.266581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.267385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.267830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.296690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:12:54.341241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:54.342444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:54.349470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.349937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.350717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.351168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.394719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0a3bbb47-9415-42ec-871d-033389168afb tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "DELETE /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 204 len: 0 microversion: 2.1 time: 0.140272 Aug 02 09:12:54.399313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 144/251] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:12:54 2022] DELETE /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:12:54.404978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:54.406185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:54.413070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.413563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.415487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.415487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.609855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:54.619492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ebc4b16-0bbb-4162-8052-d1b3ebafcf88 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1475 microversion: 2.1 time: 0.218792 Aug 02 09:12:54.620341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 145/252] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:54 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1475 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:54.864044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:54.866320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:54.887513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.888134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.889301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.891993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.934640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:54.976244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07e0ea0a-62ed-455f-9ee4-148dc1dbdfde tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.639595 Aug 02 09:12:54.989171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 108/253] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:54 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:55.011803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:55.026498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e04b0181-1b79-4675-bb9b-12d3d593e570 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1311 microversion: 2.1 time: 0.172052 Aug 02 09:12:55.028238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 146/254] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:54 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:55.643978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:55.644596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:55.651034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:55.651700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:55.652647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:55.653304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:55.810123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:55.817983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d3f24c1-af90-44ea-aa3c-e049df9181c0 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1475 microversion: 2.1 time: 0.178143 Aug 02 09:12:55.818576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 109/255] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:55 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:55.997718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:55.998337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:56.005419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.005849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.006693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.007146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.055723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:56.056343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:56.063238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.063719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.064528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.065154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.133328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:56.146597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7c57c788-6d48-402c-852f-ab5b374118b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1311 microversion: 2.1 time: 0.094588 Aug 02 09:12:56.147600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 110/256] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:56 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:56.208583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:56.216762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ce40df16-8442-413c-b100-bda6b7204bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.223057 Aug 02 09:12:56.217591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 147/257] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:55 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:56.846577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:56.847436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:56.864740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.865603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.866658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.867315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.889237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:57.133994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:57.145308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc0179bb-a932-47e6-a830-1c5d903ea220 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1475 microversion: 2.1 time: 0.302676 Aug 02 09:12:57.146622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 111/258] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:56 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:57.177616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:57.178313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:57.185459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.185905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.186691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.187709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.241258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:57.241862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:57.250622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.251457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.254795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.255841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.514355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:57.525785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-42e17068-83bb-41d0-aa19-0339dcfe56fc tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.351978 Aug 02 09:12:57.526222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:57.526348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 148/259] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:57 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:57.536038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d8bc5557-8f3e-4a67-8577-53f76e6fbe03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.298648 Aug 02 09:12:57.536630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 112/260] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:57 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:58.169084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:58.169732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:58.176096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:58.176789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.177473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:58.177903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.180836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:58.339849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.354176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f2fa0d4a-5fd4-4838-9aa1-5cdf0245ab2a tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1475 microversion: 2.1 time: 0.188518 Aug 02 09:12:58.355462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 149/261] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:58 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:58.548486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:58.549257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:58.560801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:58.562645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:58.563010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:58.563814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.566615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:58.567873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.570185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:58.570636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.571419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:58.572666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.762368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.773180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7d5754ac-ff6a-4550-bbe9-717338bd34c0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.229046 Aug 02 09:12:58.773850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 113/262] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:58 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:58.778247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.789554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-062af13e-cd4d-4b0a-b064-d2708a646e5b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.232638 Aug 02 09:12:58.790969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 150/263] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:58 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:59.383545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:59.384160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:59.390219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.390667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.391500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.392427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.539574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.548867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6f536e08-3c60-4c6c-8623-1dc4537a8427 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1475 microversion: 2.1 time: 0.169548 Aug 02 09:12:59.563139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 114/264] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:59 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1475 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:59.795241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:59.795934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:59.802370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.802902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.803700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.804134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.819085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:59.820018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:59.827040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.828351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.829162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.829606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.965136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.973930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21557f2b-ba52-4b82-bc62-9701587dcf0e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.183044 Aug 02 09:12:59.974797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 151/265] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:59 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:59.996568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:00.005608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d2b0a1c5-773c-4701-9cd9-d1e853a775c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.190074 Aug 02 09:13:00.006216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 115/266] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:12:59 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:00.579998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:00.582178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:00.588854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:00.589417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:00.590304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:00.590807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:00.775616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:00.790923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02247946-bef8-4954-b8ee-527d9219a58c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1475 microversion: 2.1 time: 0.221485 Aug 02 09:13:00.791953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 152/267] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:00 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1475 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:00.997965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:00.999764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:01.023867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-06596228-1eef-42de-a2c0-7ff6012c4507 req-081bafda-a169-47d9-a38c-de9c189a4cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f06b37-3303-42f6-b022-bc82de08102b", "name": "network-vif-deleted", "tag": "6d621682-10ee-47df-9acd-89fc4e817d6b"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:01.029766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.032204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.034554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.035313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.043724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-06596228-1eef-42de-a2c0-7ff6012c4507 req-081bafda-a169-47d9-a38c-de9c189a4cdf service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.044527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-06596228-1eef-42de-a2c0-7ff6012c4507 req-081bafda-a169-47d9-a38c-de9c189a4cdf service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.070320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-06596228-1eef-42de-a2c0-7ff6012c4507 req-081bafda-a169-47d9-a38c-de9c189a4cdf service nova] Creating event network-vif-deleted:6d621682-10ee-47df-9acd-89fc4e817d6b for instance 34f06b37-3303-42f6-b022-bc82de08102b on hv-cinder-80382 Aug 02 09:13:01.086525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-06596228-1eef-42de-a2c0-7ff6012c4507 req-081bafda-a169-47d9-a38c-de9c189a4cdf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066870 Aug 02 09:13:01.088533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 153/268] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:01.107057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:01.108168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:01.116952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.117796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.119067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.119929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.325795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.334848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-90f1ac43-292f-4fe2-9386-e3aed7c357b5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.242277 Aug 02 09:13:01.335800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 154/269] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:01 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:01.399937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.411979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6b457dca-045a-401c-9367-3580c48f27a7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.419675 Aug 02 09:13:01.424034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 116/270] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:00 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:01.817640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:01.818745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:01.835836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.836646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.837681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.838479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.898734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.899216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.899674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lazy-loading 'fault' on Instance uuid 34f06b37-3303-42f6-b022-bc82de08102b {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:13:01.970259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fe9a161dd4757a70d4c2075436901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11cb7b53383b4f708c9d508e90072d20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.992355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69c760ff-f0a8-494a-9a99-36867efdc55c tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 200 len: 1309 microversion: 2.1 time: 0.181259 Aug 02 09:13:01.993258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 155/271] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:01 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:02.360892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:02.361526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:02.369550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.370000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.370789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.371233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.420223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:02.434988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:02.435655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:02.443070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=10 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:02.443324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.443911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.445071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.445679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.518001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:02.527976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13602635-39a0-4497-9a83-c02bef6e00d7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.171840 Aug 02 09:13:02.528761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 117/272] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:02 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:02.591205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:02.600362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ced5ec8b-464a-462a-a8b8-19a809ff5a9c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.169336 Aug 02 09:13:02.601204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 156/273] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:02 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:03.015819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:03.016568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] [instance: 34f06b37-3303-42f6-b022-bc82de08102b] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:03.023480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.023948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.024735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.025216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.040894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] HTTP exception thrown: Instance 34f06b37-3303-42f6-b022-bc82de08102b could not be found. Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Request method failure captured: Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b HTTP/1.1 Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Opr2urZs6YmFao0j1pvp5ss0NwgqIhn5ugyikp--_qDXYVnHi2Tei9OePTiBQhmBb-nWtCPw2cfD48-k6vIGtwOjXLR1QwkWG_KiCAy-Z-3Pr6nxC54Rli0uNOCIWMp2D80fR3XMPW6aD1Q5xaF7ThgJkOyhYtUL6H3xslFrmNTLbw Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 11cb7b53383b4f708c9d508e90072d20 Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesNegativeTest-1369052574 Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:13:03.042727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/11cb7b53383b4f708c9d508e90072d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/11cb7b53383b4f708c9d508e90072d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_11cb7b53383b4f708c9d508e90072d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/11cb7b53383b4f708c9d508e90072d20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesNegativeTest-1369052574 Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 11cb7b53383b4f708c9d508e90072d20 Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesNegativeTest-1369052574 Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesNegativeTest-1369052574-project Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: f08fe9a161dd4757a70d4c2075436901 Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesNegativeTest-1369052574-project Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 34f06b37-3303-42f6-b022-bc82de08102b could not be found. Aug 02 09:13:03.044157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '34f06b37-3303-42f6-b022-bc82de08102b'} Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f06b37-3303-42f6-b022-bc82de08102b could not be found. Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:13:03.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f06b37-3303-42f6-b022-bc82de08102b could not be found. Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f06b37-3303-42f6-b022-bc82de08102b could not be found. Aug 02 09:13:03.046445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:13:03.047413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] Returning 404 to user: Instance 34f06b37-3303-42f6-b022-bc82de08102b could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:13:03.047413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8bbe62e2-d6bd-43b0-a527-2c0fd6ec98a7 tempest-VolumesNegativeTest-1369052574 tempest-VolumesNegativeTest-1369052574-project] 10.222.0.100 "GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b" status: 404 len: 111 microversion: 2.1 time: 0.032867 Aug 02 09:13:03.048258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 118/274] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:03 2022] GET /compute/v2.1/servers/34f06b37-3303-42f6-b022-bc82de08102b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:13:03.122417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-2c192281-9705-4fcc-8d98-e962333578b7 req-7ed0e151-ce4f-4bfe-859e-e10c04f0d86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50686e38-723f-480e-9e37-f2d5e9eaaaf0", "tag": "a3c7682a-1f13-4534-9677-cb0f7ec6315f"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:03.129979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:03.130981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:03.154142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-2c192281-9705-4fcc-8d98-e962333578b7 req-7ed0e151-ce4f-4bfe-859e-e10c04f0d86d service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.154873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-2c192281-9705-4fcc-8d98-e962333578b7 req-7ed0e151-ce4f-4bfe-859e-e10c04f0d86d service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.168391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-2c192281-9705-4fcc-8d98-e962333578b7 req-7ed0e151-ce4f-4bfe-859e-e10c04f0d86d service nova] Creating event network-changed:a3c7682a-1f13-4534-9677-cb0f7ec6315f for instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 on hv-cinder-80382 Aug 02 09:13:03.173517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-2c192281-9705-4fcc-8d98-e962333578b7 req-7ed0e151-ce4f-4bfe-859e-e10c04f0d86d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058153 Aug 02 09:13:03.174064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 157/275] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:03.554757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:03.555463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:03.564340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.565086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.565981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.566495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.627263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:03.627967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:03.634838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.635279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.638549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.639092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.831691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.842223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d26fc6a9-d526-4f8a-a777-0734ab9f676d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.220398 Aug 02 09:13:03.843393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 158/276] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:03 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:03.886382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.894781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7399781b-845c-4f59-8e71-5db2b78a9e99 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.345328 Aug 02 09:13:03.895329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 119/277] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:03 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:04.865131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:04.865898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:04.872083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.872536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:04.873359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.873801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:04.927991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:04.928628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:04.936305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.937678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:04.938587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.939065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:05.030005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:05.041510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c1115458-8c97-439d-80cc-0e935d9ded4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.180360 Aug 02 09:13:05.042611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 159/278] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:04 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:05.101795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:05.109999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8009e097-ed98-4a9b-bcc0-d6feac8b43e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.195129 Aug 02 09:13:05.110565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 120/279] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:04 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:06.062778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:06.063221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:06.070717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.071694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.073271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.078759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.136547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:06.136547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:06.142548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.143161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.144061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.144626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.257520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.283252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85a1f878-200d-4446-af3f-2bc76c96318c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.224673 Aug 02 09:13:06.286904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 160/280] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:06 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:06.431069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.440178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ec54a253-9dda-47fd-8f8e-8ef970c9639b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.311121 Aug 02 09:13:06.440772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 121/281] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:06 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:07.304619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:07.305259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:07.311581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.312030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.312811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.313267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.456141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:07.462544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:07.463267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:07.464116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-704c52ed-0f51-4bdf-abed-0b2cde8c573f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.163381 Aug 02 09:13:07.464996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 161/282] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:07 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:07.470896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.471347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.472124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.472566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.613544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:07.621204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c6f05344-9a05-44e8-b4a9-c959216df7c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.163730 Aug 02 09:13:07.621786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 122/283] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:07 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:08.485339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:08.485953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:08.495243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.495243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.495243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.495243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.569044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-adfd9a5b-5462-4379-bbec-344527acbec3 req-e610785f-6671-482e-8379-fba5e98c77b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50686e38-723f-480e-9e37-f2d5e9eaaaf0", "name": "network-vif-plugged", "status": "completed", "tag": "a3c7682a-1f13-4534-9677-cb0f7ec6315f"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:08.586771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-adfd9a5b-5462-4379-bbec-344527acbec3 req-e610785f-6671-482e-8379-fba5e98c77b0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.587610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-adfd9a5b-5462-4379-bbec-344527acbec3 req-e610785f-6671-482e-8379-fba5e98c77b0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.625193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-adfd9a5b-5462-4379-bbec-344527acbec3 req-e610785f-6671-482e-8379-fba5e98c77b0 service nova] Creating event network-vif-plugged:a3c7682a-1f13-4534-9677-cb0f7ec6315f for instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 on hv-cinder-80382 Aug 02 09:13:08.632646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-adfd9a5b-5462-4379-bbec-344527acbec3 req-e610785f-6671-482e-8379-fba5e98c77b0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070593 Aug 02 09:13:08.633649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 123/284] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:08.646698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:08.647981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:08.656734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.657319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.658331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.658941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.711935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:08.731567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0e7ea1d-c43c-4bdd-8e22-15bae95c6111 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.250573 Aug 02 09:13:08.732406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 162/285] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:08 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:08.986944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.003248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3dbd0ce2-4919-48f4-bf52-700965b5c2d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.363126 Aug 02 09:13:09.003834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 124/286] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:08 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:09.757232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:09.764150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:09.774741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:09.775593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:09.776563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:09.777206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:09.937815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.946922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5fe701d3-add6-4dc6-888c-452ab55899b5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.193947 Aug 02 09:13:09.947881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 163/287] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:09 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:10.028277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:10.029573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:10.038000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.038696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.039912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.040605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.227686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:10.236855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-568c5d61-a34f-4b46-8c60-21d61e182dc1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.213239 Aug 02 09:13:10.237514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 125/288] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:10 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:10.970031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:10.970721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:10.977244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.977705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.978493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.978963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:11.148851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:11.157019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4900d63a-3c9d-430f-9ff8-c5d23e231702 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1365 microversion: 2.1 time: 0.191207 Aug 02 09:13:11.157879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 164/289] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:10 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:11.270121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:11.271405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:11.279035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:11.287274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:11.287921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:11.289048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:11.289733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:11.454479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:11.461948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a89ef3cb-8df6-4bee-88d7-29dd61b2659e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.198106 Aug 02 09:13:11.462503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 126/290] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:11 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:12.179761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:12.180386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.187601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.188574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.189435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.189881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.340752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.348710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f809abc6-9967-4bb1-a53a-9d7cf5fa1cb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1551 microversion: 2.1 time: 0.172724 Aug 02 09:13:12.349367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 165/291] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:12 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:12.369984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:12.370558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.378494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.379167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.380331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.380699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.484578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:12.485322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.492195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.492655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.493480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.493935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.795928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.798440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:12.806008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ec868874-fbf8-417c-9f2e-aafb06cdcee6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1503 microversion: 2.1 time: 0.325768 Aug 02 09:13:12.806493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 166/292] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:12 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:12.808336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-52aad7db-e354-4d34-be6d-3e91a9448c30 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.442194 Aug 02 09:13:12.809288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 127/293] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:13:12 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-interface => generated 284 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:12.827917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ecd6d65-c0af-44bd-982b-4a730a493c43"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:12.830407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.841516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.841978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.843364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.843802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.870097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] HTTP exception thrown: Cannot 'attach_volume' instance 825f2099-d867-4685-a8b8-2c037bd7d3fd while it is in vm_state rescued Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Request method failure captured: Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/os-volume_attachments HTTP/1.1 Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 74 Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OoxdLjv3CsKs-lcNPV6JkskJP3ZAhnpNxfIhXLfcSRed6FEQoeIGTw_CTD4Wl-T03HTedRO6XpyZOASSq1OEbtEFjk4pxMbRMgyAH6FUbIPfOrocInkzRB2X91ZY5INBbVPBem3mJnllakvGRnZHUODkaWSXh__vyRW56nNV0hE86g Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:13:12.872130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 6c30f2ab48e74d4690aafe46c4bf682f Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {"volumeAttachment": {"volumeId": "5ecd6d65-c0af-44bd-982b-4a730a493c43"}} Aug 02 09:13:12.874266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Cannot 'attach_volume' instance 825f2099-d867-4685-a8b8-2c037bd7d3fd while it is in vm_state rescued Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '825f2099-d867-4685-a8b8-2c037bd7d3fd', 'body': {'volumeAttachment': {'volumeId': '5ecd6d65-c0af-44bd-982b-4a730a493c43'}}} Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:13:12.875312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 825f2099-d867-4685-a8b8-2c037bd7d3fd while it is in vm_state rescued Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:13:12.876612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 825f2099-d867-4685-a8b8-2c037bd7d3fd while it is in vm_state rescued Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Returning 409 to user: Cannot 'attach_volume' instance 825f2099-d867-4685-a8b8-2c037bd7d3fd while it is in vm_state rescued {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ca126c0-231c-45bb-b11f-abc30ab33afb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052120 Aug 02 09:13:12.878617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 167/294] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:13:12 2022] POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:13:12.887147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:12.889084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.899843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.900584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.901427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.901867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.971467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:12.989374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-36b2459e-7044-4a78-b4c1-104a7b1419dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/action" status: 202 len: 0 microversion: 2.1 time: 0.106783 Aug 02 09:13:12.990042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 128/295] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:13:12 2022] POST /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:13:12.999192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:12.999829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:13.006810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:13.007260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:13.008914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:13.009407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:13.275701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:13.291819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0f9bfcb-ca3a-4bb4-a832-18b419e834bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1511 microversion: 2.1 time: 0.297176 Aug 02 09:13:13.292851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 168/296] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:12 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:14.196326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-bc241003-7646-485a-903a-3c4ed1172052 req-bc04caeb-bf05-4fbc-b168-d33f93835026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50686e38-723f-480e-9e37-f2d5e9eaaaf0", "tag": "a3c7682a-1f13-4534-9677-cb0f7ec6315f"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:14.209280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-bc241003-7646-485a-903a-3c4ed1172052 req-bc04caeb-bf05-4fbc-b168-d33f93835026 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:14.209731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-bc241003-7646-485a-903a-3c4ed1172052 req-bc04caeb-bf05-4fbc-b168-d33f93835026 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:14.222142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-bc241003-7646-485a-903a-3c4ed1172052 req-bc04caeb-bf05-4fbc-b168-d33f93835026 service nova] Creating event network-changed:a3c7682a-1f13-4534-9677-cb0f7ec6315f for instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 on hv-cinder-80382 Aug 02 09:13:14.228280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-bc241003-7646-485a-903a-3c4ed1172052 req-bc04caeb-bf05-4fbc-b168-d33f93835026 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036819 Aug 02 09:13:14.233431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 129/297] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:14.316132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:14.316533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:14.325461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:14.326300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:14.327814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:14.328555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:14.538572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:14.547790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-144e1255-df71-4ba6-bcb9-5941881dc5d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1511 microversion: 2.1 time: 0.238329 Aug 02 09:13:14.548669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 169/298] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:14 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:15.573672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:15.575853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:15.588080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.588967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.590357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.591093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.754274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:15.762398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d35c39c4-bc3f-4940-b16e-57d9c918dc5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1511 microversion: 2.1 time: 0.196470 Aug 02 09:13:15.762984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 130/299] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:15 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:16.784337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:16.785692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:16.792462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.793476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.794579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.795012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.985991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:16.994971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8a075d6-9edb-436d-bb5e-123774c0a6af tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1511 microversion: 2.1 time: 0.214539 Aug 02 09:13:16.995915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 170/300] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:16 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:18.020410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:18.021228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:18.036603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:18.037337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:18.038473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:18.039688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:18.333368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:18.341406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-12792329-55b3-4405-98d6-350203b1de82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1511 microversion: 2.1 time: 0.326376 Aug 02 09:13:18.341975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 131/301] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:18 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:19.366648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:19.367357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:19.376572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:19.377553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:19.378603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:19.379124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:19.943448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:19.952837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f4531351-075e-4d7e-b05e-77f627e95bda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1517 microversion: 2.1 time: 0.590953 Aug 02 09:13:19.953961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 171/302] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:19 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:21.548111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a36068c6-7e04-4040-bd17-a1d33b53f71b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'create', calling method: .version_select at 0x7f8c1820de50>, body: {"keypair": {"name": "tempest-keypair-303963766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4mP03qFaCqvq+5zje59avrO4usnQ8vhh7+XMUCOa5CccHaxUNH5xSVg5suO6KMq48nuBZZcAxraKHbo7qljp3Adjn0EC8w2ZL1sZQAPZXE9bCKYlVaFe+ExNXMAG5Ubw=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:21.588048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-a36068c6-7e04-4040-bd17-a1d33b53f71b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:21.596441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-a36068c6-7e04-4040-bd17-a1d33b53f71b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for user 6c30f2ab48e74d4690aafe46c4bf682f and project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:21.640370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a36068c6-7e04-4040-bd17-a1d33b53f71b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096541 Aug 02 09:13:21.642750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 132/303] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:13:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:23.299630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:23.300132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:23.317747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.318087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.319110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.319698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.384164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-938f7b09-e7db-4c70-832a-2a0c617f6bb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/ips" status: 200 len: 149 microversion: 2.1 time: 0.091587 Aug 02 09:13:23.393583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 172/304] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:13:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/ips => generated 149 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:25.165664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:25.166583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:25.199919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.200447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.204334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.204935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.298273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8916de93-66ca-47c5-815c-fce73fce26d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/ips" status: 200 len: 151 microversion: 2.20 time: 0.137099 Aug 02 09:13:25.308249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 133/305] 10.222.0.100 () {60 vars in 1294 bytes} [Tue Aug 2 09:13:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/ips => generated 151 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:13:25.518221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef39c29f-d8cc-4b8d-9e22-89a2668d8edb"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:25.523769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:25.547973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.548663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.552528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.557441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.849903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1370558488", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdd10181-079c-4c33-b570-aa5043e645f8"}], "security_groups": [{"name": "tempest-securitygroup--1042004728"}], "key_name": "tempest-keypair-303963766", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:26.074993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] validate_networks() for [('bdd10181-079c-4c33-b570-aa5043e645f8', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:13:26.627194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ee2072b-c7b5-408b-9991-8df31a345594 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116731 Aug 02 09:13:26.639258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 173/306] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:13:25 2022] POST /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 194 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:27.138188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:13:27.139296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:13:27.140275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:13:27.140707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:13:27.141421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:13:27.153744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.155090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:27.156451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.157073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:27.184709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:27.199733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Getting quotas for user 6c30f2ab48e74d4690aafe46c4bf682f and project 279f631bf3db4ba7a0aff00226cf5724. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:27.279548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:13:27.282092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:13:27.408716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1739b7ec-afd5-46f6-a90f-8c1d522707fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.537059 Aug 02 09:13:27.416711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 134/307] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:13:25 2022] POST /compute/v2.1/servers => generated 411 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:13:27.423722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f1aaa208-f814-496b-ac23-3e01e7506cc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:27.424664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f1aaa208-f814-496b-ac23-3e01e7506cc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:27.792947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f1aaa208-f814-496b-ac23-3e01e7506cc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:27.819459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f1aaa208-f814-496b-ac23-3e01e7506cc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1249 microversion: 2.1 time: 0.400573 Aug 02 09:13:27.821813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 174/308] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1249 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:28.030765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:28.031866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:28.058780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.059235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.060038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.060477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.132711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lazy-loading 'flavor' on Instance uuid c376609c-79b9-4ca5-91a3-febc97aecc9d {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:13:28.636274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6dfd797f-0b89-4acc-9fc7-b3a58035a7da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/action" status: 202 len: 0 microversion: 2.20 time: 0.610761 Aug 02 09:13:28.637278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 135/309] 10.222.0.100 () {62 vars in 1324 bytes} [Tue Aug 2 09:13:28 2022] POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:13:28.648557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:28.649593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:28.665550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.671448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.672428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.676003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.844077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:28.845335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:28.858655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.859433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.860572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.861562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.992939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:29.016425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:29.018603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:29.020164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c3cc560a-93a9-4f3e-8528-c72fc7297c94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.377620 Aug 02 09:13:29.021518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 175/310] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:29.056851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:29.067382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-baec4f45-2280-4cfc-b003-018ad95cbc0f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1301 microversion: 2.1 time: 0.227877 Aug 02 09:13:29.068208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 136/311] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1301 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:30.059896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:30.063297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:30.074114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:30.075328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:30.077956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:30.079615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:30.095685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:30.107246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:30.122698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:30.125166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:30.128207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:30.130393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:30.279868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.296359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-16060c6e-b32e-4da1-a294-d4a8e6a4138b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1307 microversion: 2.1 time: 0.205603 Aug 02 09:13:30.298063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 137/312] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:30.525345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.547209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.550554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.556972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a56b06df-29f6-487b-9fb4-807771552e8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.512007 Aug 02 09:13:30.557972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 176/313] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:31.329303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:31.329303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:31.337950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.338416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.339215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.339660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.515091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:31.530817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8715c08a-6d32-4b93-9f9a-fdbb900543c4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1307 microversion: 2.1 time: 0.211632 Aug 02 09:13:31.531413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 138/314] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:31.589746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:31.590367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:31.600119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.611721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.612840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.613479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:32.225820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.241773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.246859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.249398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-92fac80e-0598-48bb-b380-60aa16e2c81a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.663578 Aug 02 09:13:32.265904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 177/315] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:32.557476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:32.558249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:32.567191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:32.567659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:32.568461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:32.569019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.276125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:33.276750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:33.294199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=44 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:33.297444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:33.309979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.311635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:33.312354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.465569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:33.488154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b8ba5b5-6f4f-4402-bdce-6011d5072089 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.935406 Aug 02 09:13:33.505959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 139/316] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:34.009134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:34.030700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:34.034584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:34.040805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-945ca9ab-c512-42e2-ba3d-c9f348c5a6f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.768537 Aug 02 09:13:34.041737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 178/317] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:34.341091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-26d53b5a-20a8-404c-80b4-d27c7973a878 req-6dd1bfdf-9c54-4d58-8e36-b8dbb748a5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:34.360148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-26d53b5a-20a8-404c-80b4-d27c7973a878 req-6dd1bfdf-9c54-4d58-8e36-b8dbb748a5b8 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.365273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-26d53b5a-20a8-404c-80b4-d27c7973a878 req-6dd1bfdf-9c54-4d58-8e36-b8dbb748a5b8 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:34.393720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-26d53b5a-20a8-404c-80b4-d27c7973a878 req-6dd1bfdf-9c54-4d58-8e36-b8dbb748a5b8 service nova] Creating event network-changed:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:13:34.402876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-26d53b5a-20a8-404c-80b4-d27c7973a878 req-6dd1bfdf-9c54-4d58-8e36-b8dbb748a5b8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067131 Aug 02 09:13:34.409912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 140/318] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:34.527153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:34.527858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:34.536773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.545529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:34.546940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.547416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:34.802695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:34.816023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-75fed776-5568-41d9-b3f9-157da5e9c77b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.292245 Aug 02 09:13:34.816640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 179/319] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:34.898942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-65e2a8c4-c957-4da1-b801-38557847a67c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: .version_select at 0x7f8c18348e50>, body: {"keypair": {"name": "tempest-keypair-418026798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1wB+K7gMESaGCgaY0mNd74WJ4qnIe4P0qIsdBcsnKiIRj9XAEQ+A/ny2ivojeHRfAOCs4OctMr3di6rv0hkIHaP2P3PlPfl9dQwvrufgbDL6kHrDne8KkHt69HkLlqqA=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:34.956009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-65e2a8c4-c957-4da1-b801-38557847a67c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:34.961148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-65e2a8c4-c957-4da1-b801-38557847a67c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:34.996784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-65e2a8c4-c957-4da1-b801-38557847a67c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104944 Aug 02 09:13:35.006553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 141/320] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:13:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:35.071210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:35.071853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:35.086479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:35.086935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:35.087737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:35.088181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:35.338699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.349211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.352348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.354040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cac8d3a3-ca9a-49e1-89d9-342999fb3de8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.287364 Aug 02 09:13:35.355120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 180/321] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:35.840715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:35.841521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:35.865888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:35.866361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:35.869827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:35.870285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.380360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:36.381654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:36.395636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:36.400240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.401349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:36.401961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.647886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:36.666761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-472e4358-ca7f-4235-bb87-5809335169b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.830689 Aug 02 09:13:36.672713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 142/322] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:36.994846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.010615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.016537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.018910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4e5b8173-d2fe-4eb1-9516-4bec3d8e71e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.642957 Aug 02 09:13:37.021397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 181/323] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:37.691957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:37.696421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:37.702731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:37.709673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:37.710601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:37.711616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:37.712428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:38.045173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:38.045968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:38.048400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:38.057086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:38.057572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:38.067779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:38.068408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:38.449546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.469299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.470849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.472104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-302c0cbc-9bd4-4ebd-8961-c42c29fa7adb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.431047 Aug 02 09:13:38.472685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 182/324] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:38.629225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.643267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ace44a21-5794-4558-aeaa-0934b56068c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.957769 Aug 02 09:13:38.644834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 143/325] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:39.409914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-647791984", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "networks": [{"uuid": "1130a76e-7b0e-4fad-aa2d-3296fa2a5662"}]}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:39.496371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:39.497186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:39.519818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:39.524362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.526654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:39.527554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.535753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] validate_networks() for [('1130a76e-7b0e-4fad-aa2d-3296fa2a5662', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:13:40.133450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:40.142212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:40.143746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:40.144959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-738e88ca-2913-4a9b-9040-034c297f0918 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.652842 Aug 02 09:13:40.155946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 144/326] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:40.168277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:40.168907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:40.180969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:40.186411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:40.187390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:40.187845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:40.378715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:13:40.380210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:13:40.383666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:13:40.384497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:13:40.385079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:13:40.400222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:40.400920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:40.401989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:40.402576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:40.430160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Getting quotas for project 0d0ba64c011a419b9cc8f5501a8606ac. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:40.438498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Getting quotas for user b074a126a458485e882a9e9eea178dca and project 0d0ba64c011a419b9cc8f5501a8606ac. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:40.466834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:13:40.469707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:13:40.541398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd7a0d6b-52a6-43fc-b655-69496367dfa5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.135478 Aug 02 09:13:40.542323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 183/327] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:13:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:13:40.556509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1934352167", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "525d665a-147a-4b35-9ac1-0f68a0b121ae"}], "security_groups": [{"name": "tempest-securitygroup--303211291"}], "key_name": "tempest-keypair-418026798", "user_data": "}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:40.757662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] validate_networks() for [('525d665a-147a-4b35-9ac1-0f68a0b121ae', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:13:40.771639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:40.785862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-db4f679b-ef6a-40f0-afae-396dc7738a7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.628661 Aug 02 09:13:40.787189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 145/328] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:40.794067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26475aec-c947-41c9-88ec-df9623ceb7fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:40.795636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26475aec-c947-41c9-88ec-df9623ceb7fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.361015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26475aec-c947-41c9-88ec-df9623ceb7fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.424685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26475aec-c947-41c9-88ec-df9623ceb7fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1222 microversion: 2.1 time: 0.634257 Aug 02 09:13:41.427427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 146/329] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:40 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1222 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:41.443340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:41.447307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.460986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:41.462677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.463520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.466097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.467447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.546989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:13:41.547549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:13:41.548189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:13:41.549389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:13:41.549878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:13:41.564865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.565411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.566268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.566713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.599539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:41.611381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:41.626456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:13:41.628855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:13:41.713742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f2ca1e3e-3dc8-426e-8f21-9fbf4c82afcb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.164994 Aug 02 09:13:41.721325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 184/330] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:13:40 2022] POST /compute/v2.1/servers => generated 403 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:13:41.734477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cce494c8-f222-4daa-b3d8-b092e76f3262 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:41.735026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cce494c8-f222-4daa-b3d8-b092e76f3262 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.821573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cce494c8-f222-4daa-b3d8-b092e76f3262 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.830188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cce494c8-f222-4daa-b3d8-b092e76f3262 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1245 microversion: 2.1 time: 0.105772 Aug 02 09:13:41.845086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 185/331] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:41 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:41.851433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:41.852293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.876380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.877072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.878093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.878682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.885189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:41.946149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.979266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.980842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.982177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cbf0311d-6ce6-4be4-80a7-a6e65acffb2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.552685 Aug 02 09:13:41.982735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 147/332] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:42.136390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:42.147221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1abe3601-7e8e-4600-ba0a-9a71516691ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.300033 Aug 02 09:13:42.148252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 186/333] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:42.359559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87d37f38-d6c9-45b1-8e9c-c4e8b8bf1109 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Action: 'create', calling method: .version_select at 0x7f8c1849ac10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1502777233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKURsA07N/sjugn4qO5p5GOs0XAX0LM4rm+GHP9SiDEHvgPFRc/kYYTjsB1QWtsJNfWBxeE2ROhvhr7fX24CrCQpK0ewMWPqdIT+5ympC8n9J/PswGjXP2EL7pWwAFzCg=="}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:42.404463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-87d37f38-d6c9-45b1-8e9c-c4e8b8bf1109 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Getting quotas for project a6dd8f336ea44f14bfaf1c127ddbacb1. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:42.420307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-87d37f38-d6c9-45b1-8e9c-c4e8b8bf1109 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Getting quotas for user 4f1e5fb6488d4478b8f4449295613e50 and project a6dd8f336ea44f14bfaf1c127ddbacb1. Resources: {'key_pairs'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:42.482727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87d37f38-d6c9-45b1-8e9c-c4e8b8bf1109 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.469936 Aug 02 09:13:42.483347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 148/334] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:13:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:42.500585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:42.512207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:42.529999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.530774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.531802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.538855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.648040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6dc58c69-71be-4d56-baef-496991717f38 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Action: 'create', calling method: .version_select at 0x7f8c18150430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1891613438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFUxEwUbMmbZUGGqBqOa8y2wyDN5yoKXOwyMknqHPcFZwuqMIuY/BqMAr0ocPZowqQFsccdD0gBV3MyLAoJSnJKcurYV8HPpeaZJBmrwLY70AjX8S+JA4CuJOquzC6QSA=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:42.682233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-6dc58c69-71be-4d56-baef-496991717f38 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Getting quotas for project 9a4b022cdf9c448dbb51c5ffd9212181. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:42.689794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:42.691227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-6dc58c69-71be-4d56-baef-496991717f38 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Getting quotas for user d22a27db106e45e68444fa022d254c83 and project 9a4b022cdf9c448dbb51c5ffd9212181. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:42.693618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:42.702775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8b55e8fc-050f-4bfb-ac26-95892aa9ab3c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1282 microversion: 2.1 time: 0.218328 Aug 02 09:13:42.713595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 149/335] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:42 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:42.738629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6dc58c69-71be-4d56-baef-496991717f38 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.358269 Aug 02 09:13:42.739539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 187/336] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:13:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:42.853397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:42.854201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:42.868517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.869349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.871452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.872323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.002623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.016398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:43.018621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:43.032665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d5d41c86-cb0c-4c57-998b-0ab319a754d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1241 microversion: 2.1 time: 0.183674 Aug 02 09:13:43.036187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.037155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 150/337] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:42 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:43.037796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.038780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.039382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.175569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:43.176968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:43.193963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.194722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.195704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.196378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.351613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.358094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.359977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.361864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-27741174-f735-4e11-9992-1a00cc6d5c51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.355786 Aug 02 09:13:43.381573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 188/338] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:43.386574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-8620a59f-2b99-4dfc-9dc7-0bca3750c8f4 req-e1e5a1a9-ec2c-456c-80fb-5ccf4d858cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "name": "network-vif-plugged", "status": "completed", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:43.398044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-8620a59f-2b99-4dfc-9dc7-0bca3750c8f4 req-e1e5a1a9-ec2c-456c-80fb-5ccf4d858cae service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.398559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-8620a59f-2b99-4dfc-9dc7-0bca3750c8f4 req-e1e5a1a9-ec2c-456c-80fb-5ccf4d858cae service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.412985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-8620a59f-2b99-4dfc-9dc7-0bca3750c8f4 req-e1e5a1a9-ec2c-456c-80fb-5ccf4d858cae service nova] Creating event network-vif-plugged:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:13:43.418411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-8620a59f-2b99-4dfc-9dc7-0bca3750c8f4 req-e1e5a1a9-ec2c-456c-80fb-5ccf4d858cae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035381 Aug 02 09:13:43.421385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 189/339] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:43.516768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.531032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad9c6b60-034c-43cf-b50e-ab1be64ce5f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.363280 Aug 02 09:13:43.552446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 151/340] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:43.730810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:43.732682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:43.755518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.757024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.760773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.762976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.073729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:44.074540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:44.094770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.109429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.114027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.120987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.346006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:44.346874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:44.357715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c702189d-a158-40e6-bc5e-e5ba766e9473 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1303 microversion: 2.1 time: 0.296768 Aug 02 09:13:44.375317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 152/341] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:44 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:44.377102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e02ba8cc-89a1-4465-8fb8-3e61076057bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.648391 Aug 02 09:13:44.378842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 190/342] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:44.399650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:44.400313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:44.408111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.408765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.410332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.411085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.573479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:44.574563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:44.585620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.586416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.587360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.588007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.812087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:44.826513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-44675982-e2ff-4e68-aedd-95b8c31fb786 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.259056 Aug 02 09:13:44.827653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 191/343] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:45.049059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.065480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.067701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.069311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ecaa154a-0447-4dd8-8da8-282e452ca80e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1727 microversion: 2.20 time: 0.674390 Aug 02 09:13:45.070612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 153/344] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1727 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:45.387168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:45.388173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:45.398897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.399617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.400582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.401205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.415214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:45.415853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:45.433623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.434089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.449240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.450101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.552557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.572858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-96a32d54-4296-465a-ac22-0d74b503a671 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1303 microversion: 2.1 time: 0.193440 Aug 02 09:13:45.574087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 192/345] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:45 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1303 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:45.864037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:45.870052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:45.883110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.883557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.884995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.885472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.996181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.010315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2927dd22-d88c-4dc5-931d-5091d680d154 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.613726 Aug 02 09:13:46.019301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 154/346] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:46.099855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:46.100989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:46.140349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.141236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.142363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.142965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.182193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.191270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-675ff0f0-5c41-4a5a-a9f0-0c53f3841e23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1375 microversion: 2.1 time: 0.340529 Aug 02 09:13:46.219712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 193/347] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1375 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:46.594757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:46.596476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:46.624761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.626789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.630537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.632232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.806637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.818857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-879ae453-3489-4b0a-a055-4c3b218d43f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1303 microversion: 2.1 time: 0.228565 Aug 02 09:13:46.819459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 194/348] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:46 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:47.038499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.040927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.052111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.052763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.054217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.055256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.369452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.382349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.386557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab59f47a-144a-403c-a105-60d15e02a4d2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.353388 Aug 02 09:13:47.388469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 195/349] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:47.402640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.403250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.409043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.411254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.412654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5b753d01-3f91-4c09-aa4b-bc61c8de26de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1748 microversion: 2.20 time: 1.319720 Aug 02 09:13:47.419943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 155/350] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1748 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:47.434130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.435061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.437357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.438406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.490672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-a6b401df-95ae-40c1-8730-a5c0564e3b9e req-993f306f-59a3-430f-815d-16598b999d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77bbf4ed-4629-41b6-b0c2-56aed8108028", "tag": "77abd36f-7703-4513-bced-f8f25bf34dc4"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:47.524309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a6b401df-95ae-40c1-8730-a5c0564e3b9e req-993f306f-59a3-430f-815d-16598b999d48 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.532346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-a6b401df-95ae-40c1-8730-a5c0564e3b9e req-993f306f-59a3-430f-815d-16598b999d48 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.563791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-a6b401df-95ae-40c1-8730-a5c0564e3b9e req-993f306f-59a3-430f-815d-16598b999d48 service nova] Creating event network-changed:77abd36f-7703-4513-bced-f8f25bf34dc4 for instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 on hv-cinder-80382 Aug 02 09:13:47.573563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-a6b401df-95ae-40c1-8730-a5c0564e3b9e req-993f306f-59a3-430f-815d-16598b999d48 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087230 Aug 02 09:13:47.574189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 156/351] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:47.684488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.697137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ed7ae128-b4bc-4994-a6d7-7309131f3eb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1567 microversion: 2.1 time: 0.306660 Aug 02 09:13:47.697990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 196/352] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:47.726244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.727451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.737194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.737675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.738455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.739057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.847933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.851417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.860228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.860696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.861620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.862222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.109876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0842b20f-dcab-4b5a-b088-46739cd49298 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.389752 Aug 02 09:13:48.111050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 157/353] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-interface => generated 284 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:48.159103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:48.173755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-28b940d2-5798-4f47-a550-935bb89af288 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.335612 Aug 02 09:13:48.174742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 197/354] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:48.411317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:48.412744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:48.424082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.425300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.427077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.428161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.440533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:48.441481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:48.451503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.452238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.453232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.453815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.038814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.050857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.053739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.055120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9f03147a-8ff9-4925-9e61-27686bee9b09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.620172 Aug 02 09:13:49.056893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 198/355] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:49.103517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-43e596de-7c98-4f35-a56b-226f1d284be4 req-f600d4c6-317e-4b20-bb8b-ce1c77d4f18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "name": "network-vif-plugged", "status": "completed", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:49.126756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-43e596de-7c98-4f35-a56b-226f1d284be4 req-f600d4c6-317e-4b20-bb8b-ce1c77d4f18c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.127198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-43e596de-7c98-4f35-a56b-226f1d284be4 req-f600d4c6-317e-4b20-bb8b-ce1c77d4f18c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.142259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-43e596de-7c98-4f35-a56b-226f1d284be4 req-f600d4c6-317e-4b20-bb8b-ce1c77d4f18c service nova] Creating event network-vif-plugged:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:13:49.147674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-43e596de-7c98-4f35-a56b-226f1d284be4 req-f600d4c6-317e-4b20-bb8b-ce1c77d4f18c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048959 Aug 02 09:13:49.148313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 199/356] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:49.196874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:49.197637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:49.204370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.204813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.205613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.206045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.319305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.330267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b4a6f7dd-a397-4037-bd92-855f798fec16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.923604 Aug 02 09:13:49.331891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 158/357] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:48 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:49.387523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.395420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-826e7596-92f4-4114-bb1b-e5aadf3a02c8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.203004 Aug 02 09:13:49.396013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 200/358] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:49 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:50.081549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:50.082171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:50.096230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.096676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.097506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.097938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.353598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:50.354219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:50.361455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.361905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.362725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.363160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.520777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.537965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.542133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.542133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-42cfaaf1-0ca6-4ab8-b057-e37fbbfdef55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.463350 Aug 02 09:13:50.545431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 159/359] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:50.550986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:50.551877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:50.558392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.566519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.566732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f25b1bfd-6f78-4d84-9c68-2fc280013e31 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.217027 Aug 02 09:13:50.567406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.567738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 201/360] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:50.570156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.570824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.643091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-80ab58df-c0bb-44da-932f-7572c7c4c433 req-a6dcde3f-3803-4fa9-9115-8eecfbad8e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddaf95ef-cb6f-4ed0-a20d-a4df82191123", "tag": "3c66bd43-60f2-46b5-ab91-79f33bed866d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:50.658520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-80ab58df-c0bb-44da-932f-7572c7c4c433 req-a6dcde3f-3803-4fa9-9115-8eecfbad8e01 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.661670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-80ab58df-c0bb-44da-932f-7572c7c4c433 req-a6dcde3f-3803-4fa9-9115-8eecfbad8e01 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.682468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-80ab58df-c0bb-44da-932f-7572c7c4c433 req-a6dcde3f-3803-4fa9-9115-8eecfbad8e01 service nova] Creating event network-changed:3c66bd43-60f2-46b5-ab91-79f33bed866d for instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 on hv-cinder-80382 Aug 02 09:13:50.688814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-80ab58df-c0bb-44da-932f-7572c7c4c433 req-a6dcde3f-3803-4fa9-9115-8eecfbad8e01 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051636 Aug 02 09:13:50.689888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 202/361] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:51.068730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.077680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-267372f2-dc73-4bd0-8e62-ba98b62fd3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.530659 Aug 02 09:13:51.078430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 160/362] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:50 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:51.567576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:51.568333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:51.574825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.575922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.576907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.577451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.589672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:51.590290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:51.596335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:51.600260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.601014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.602610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.603053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.748927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.760150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.762286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.764669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-35b6f37d-0480-4e7a-b571-0785190c082a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.201910 Aug 02 09:13:51.765792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 203/363] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:51.771716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.780299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-85c47ae6-fba9-4f33-9563-0a498ed6df7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.194841 Aug 02 09:13:51.781252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 161/364] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:52.100190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.100810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.107937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.108301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.109169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.109752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.274543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.282703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cfe6f272-d7bb-4df3-bc84-17093f7c7bde tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.186512 Aug 02 09:13:52.283604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 204/365] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:52.724139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-7202a936-478b-4cb1-9fff-648d85c0f083 req-3bf5c56c-cf94-4f0d-9703-96c7e21d2e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:52.729065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=20 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:52.736741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-7202a936-478b-4cb1-9fff-648d85c0f083 req-3bf5c56c-cf94-4f0d-9703-96c7e21d2e1f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.737136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-7202a936-478b-4cb1-9fff-648d85c0f083 req-3bf5c56c-cf94-4f0d-9703-96c7e21d2e1f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.748714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-7202a936-478b-4cb1-9fff-648d85c0f083 req-3bf5c56c-cf94-4f0d-9703-96c7e21d2e1f service nova] Creating event network-changed:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:13:52.754136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-7202a936-478b-4cb1-9fff-648d85c0f083 req-3bf5c56c-cf94-4f0d-9703-96c7e21d2e1f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Aug 02 09:13:52.754775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 162/366] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:52.788891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.789661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.792013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=18 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:52.802681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.803482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.812745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.813255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.814826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.815439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.815882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.816385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.816507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.816868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.011005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.013796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:53.021641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.023177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.024423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9487d666-5553-42c1-8e15-842c88ccfeca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.239506 Aug 02 09:13:53.025229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 205/367] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:53.170347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-cafce0db-4763-465c-b552-31eb91492976 req-880e4144-37d3-4a72-ab67-2734ecb3605e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77bbf4ed-4629-41b6-b0c2-56aed8108028", "name": "network-vif-plugged", "status": "completed", "tag": "77abd36f-7703-4513-bced-f8f25bf34dc4"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:53.182878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-cafce0db-4763-465c-b552-31eb91492976 req-880e4144-37d3-4a72-ab67-2734ecb3605e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.188800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-cafce0db-4763-465c-b552-31eb91492976 req-880e4144-37d3-4a72-ab67-2734ecb3605e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.205191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.216901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8e530b21-ad5a-4d2f-93b4-e03213665dbf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.418354 Aug 02 09:13:53.217860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 163/368] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:53.221319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-cafce0db-4763-465c-b552-31eb91492976 req-880e4144-37d3-4a72-ab67-2734ecb3605e service nova] Creating event network-vif-plugged:77abd36f-7703-4513-bced-f8f25bf34dc4 for instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 on hv-cinder-80382 Aug 02 09:13:53.226950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-cafce0db-4763-465c-b552-31eb91492976 req-880e4144-37d3-4a72-ab67-2734ecb3605e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060961 Aug 02 09:13:53.227972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 206/369] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:53.308473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:53.309104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:53.316512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.316991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.317805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.319087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.940870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.954926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e6eee7e-4e34-4f41-b947-14acdb651d63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.651789 Aug 02 09:13:53.955647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 164/370] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:53 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:54.050388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.051225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.053610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:54.059503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.060149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.061200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.061650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.203269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:54.212010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:54.213560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:54.214739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9a685836-a22f-47e3-a009-8b9919cbd4ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.170505 Aug 02 09:13:54.215310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 207/371] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:54.239857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.240479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.247026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.247471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.248243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.248673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.548951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:54.556459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-71bf4cec-dd0b-4baf-91a8-5c8010f837cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.320771 Aug 02 09:13:54.557029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 165/372] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:54.980057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.980750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.989407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.989855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.990648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.991088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.183626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.194697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9f2b9bd1-1f81-45c4-85a6-88f6d9373c83 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.219746 Aug 02 09:13:55.195639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 208/373] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:55.240189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:55.240941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:55.248692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.249161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.250173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.250841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.417613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.432625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.434068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.435502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1fbf27f2-cc12-413b-b1bc-14d37c74091e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.199033 Aug 02 09:13:55.436109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 166/374] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:55.577389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:55.578013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:55.584148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.584600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.585411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.585853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.730009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.738347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b5d9377-eb2e-44a4-ae39-b9e552707922 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1322 microversion: 2.1 time: 0.164914 Aug 02 09:13:55.738933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 209/375] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:55 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:56.216336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.216989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.224359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.224944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.225882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.226397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.371448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.379823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c1747e7-ebb3-4b95-bd89-d29836542a0b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.167515 Aug 02 09:13:56.380654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 167/376] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:56.459229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.459854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.466413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.466889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.467679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.468115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.618318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.626809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.628229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.630210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-22d330f8-7629-4f37-b00e-f35aa6c2f954 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.174631 Aug 02 09:13:56.630810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 210/377] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:56.759816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.760468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.768253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.768710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.769518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.769966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.772813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:56.916044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.924174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5550b8af-d682-45e2-92b9-50d56e408fa9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1511 microversion: 2.1 time: 0.168206 Aug 02 09:13:56.924813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 168/378] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:57.202384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-79e5ae03-42c9-4746-9cfa-c8d20edbca8b req-b987faa4-e6a6-4565-a8f4-543d7dae5378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddaf95ef-cb6f-4ed0-a20d-a4df82191123", "name": "network-vif-plugged", "status": "completed", "tag": "3c66bd43-60f2-46b5-ab91-79f33bed866d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:57.214170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-79e5ae03-42c9-4746-9cfa-c8d20edbca8b req-b987faa4-e6a6-4565-a8f4-543d7dae5378 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.214615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-79e5ae03-42c9-4746-9cfa-c8d20edbca8b req-b987faa4-e6a6-4565-a8f4-543d7dae5378 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.226799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-79e5ae03-42c9-4746-9cfa-c8d20edbca8b req-b987faa4-e6a6-4565-a8f4-543d7dae5378 service nova] Creating event network-vif-plugged:3c66bd43-60f2-46b5-ab91-79f33bed866d for instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 on hv-cinder-80382 Aug 02 09:13:57.232513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-79e5ae03-42c9-4746-9cfa-c8d20edbca8b req-b987faa4-e6a6-4565-a8f4-543d7dae5378 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 Aug 02 09:13:57.233190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 211/379] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:57.402692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:57.403314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:57.410470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.411260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.412071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.412510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.598912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.607681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b69fc44a-0be6-4029-a9fc-6b4a820df634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.207681 Aug 02 09:13:57.608263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 169/380] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:57 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:57.658212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:57.658952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:57.665563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.666006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.666785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.667221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.825402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.834485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.836019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.837248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e2f1bcd7-c771-4742-8995-3a15f8712de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.185856 Aug 02 09:13:57.838110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 212/381] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:58.628505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.629228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.636274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.636727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.638200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.638643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.778955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:58.786617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-473d40d8-e87f-45f6-bcbd-18c6855dd002 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1370 microversion: 2.1 time: 0.162217 Aug 02 09:13:58.787191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 170/382] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:58.862954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.863573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.870251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.870702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.872506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.872506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.021046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:59.030369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:59.031890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:59.033078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-735ec1ed-8bde-4c1b-9f86-97e8f609fa34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.174088 Aug 02 09:13:59.033680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 213/383] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:59.808181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:59.808998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:59.816250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.816732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.817539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.817979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.061254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:00.062045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:00.062706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.068911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.069404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.070203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.070635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.072030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f5d8316-1fdb-483e-ae37-c06751a12a4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1561 microversion: 2.1 time: 0.267708 Aug 02 09:14:00.085404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 171/384] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:13:59 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1561 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:00.097001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:00.097619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:00.103907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.104356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.105147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:00.105643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.216011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.224590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.226159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.226291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f7c43b46-874c-469d-bcaa-84741cab173e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135958 Aug 02 09:14:00.227071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 172/385] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:14:00 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:00.227541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6e5a6fa-7c66-4789-873d-0e1921d2ebe9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.172923 Aug 02 09:14:00.228075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 214/386] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:01.251292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:01.252522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:01.259738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.260290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.261171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.261696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.744332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:01.758699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-28adcc0c-4580-4425-af49-e0ff8837e685 req-f0250189-5055-4a54-8215-13b7b3670f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddaf95ef-cb6f-4ed0-a20d-a4df82191123", "tag": "3c66bd43-60f2-46b5-ab91-79f33bed866d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:01.768068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:01.771399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-28adcc0c-4580-4425-af49-e0ff8837e685 req-f0250189-5055-4a54-8215-13b7b3670f79 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.771599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:01.771846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-28adcc0c-4580-4425-af49-e0ff8837e685 req-f0250189-5055-4a54-8215-13b7b3670f79 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.773723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0fd2f7ba-1126-4a0b-ade1-4a77f538c93a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.527511 Aug 02 09:14:01.774953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 173/387] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:01.792942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-28adcc0c-4580-4425-af49-e0ff8837e685 req-f0250189-5055-4a54-8215-13b7b3670f79 service nova] Creating event network-changed:3c66bd43-60f2-46b5-ab91-79f33bed866d for instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 on hv-cinder-80382 Aug 02 09:14:01.798645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-28adcc0c-4580-4425-af49-e0ff8837e685 req-f0250189-5055-4a54-8215-13b7b3670f79 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044422 Aug 02 09:14:01.799258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 215/388] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:02.167666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.168170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.176115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.176498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.177330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.177777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.204000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7451361-6773-4a26-8bb7-fc9776968c4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/ips" status: 200 len: 146 microversion: 2.1 time: 0.040205 Aug 02 09:14:02.210210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 174/389] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:02.800394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.801267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.826829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.827273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.828112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.828545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.985955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:02.994961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:02.996333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:02.998482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4dd2da83-2c3e-493a-8960-ef88f7c50127 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.202989 Aug 02 09:14:02.999056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 216/390] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:04.022855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:04.023478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:04.031285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:04.031751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:04.032534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:04.032976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:04.172199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:04.180344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:04.181935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:04.183129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47022cad-d6b2-4946-aa9c-5d6526fa398b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.164291 Aug 02 09:14:04.183693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 175/391] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:05.207062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:05.207707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:05.214373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:05.214825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:05.215676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:05.216116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:05.356151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:05.364466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:05.365980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:05.367144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-620ead1e-5456-4f54-8102-e3348a220bae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.164284 Aug 02 09:14:05.367705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 217/392] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:06.127573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf7bd558-b0dd-4fd5-9d43-539ea4a31978"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:06.130316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:06.137179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.138135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.139002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.139433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.394324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:06.395264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:06.403003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.403723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.405320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:06.406385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.492075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73e06041-fc96-4f79-b845-54199f872c75 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368815 Aug 02 09:14:06.493792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 176/393] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:14:06 2022] POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:06.681526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:06.692988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:06.696116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:06.703023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81b23623-aa9b-4705-b67e-3f567540c695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.314685 Aug 02 09:14:06.703999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 218/394] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:07.742141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:07.743787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:07.752989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.754082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.755396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.756119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.958281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:07.975935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:07.977488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:07.978696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f4fe7dfa-4ffd-4e2f-a31f-d3fd627a5008 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.248041 Aug 02 09:14:07.979773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 177/395] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:09.003036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:09.004519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:09.011710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.012380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.013449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.014128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.186596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:09.195176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:09.197004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:09.198230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-002444e6-e319-468a-b78d-7c6dc0e03639 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.199317 Aug 02 09:14:09.198797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 219/396] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:10.223432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:10.226728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:10.235484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:10.236258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:10.237277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:10.237720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:10.387595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:10.396629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:10.398283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:10.399788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a5ba3751-23e3-4f37-91fe-03a3801adfa6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.180828 Aug 02 09:14:10.413667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 178/397] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:11.427750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:11.429099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:11.436140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:11.436913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:11.437978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:11.438423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:11.626233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:11.636124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:11.638622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:11.640187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21472632-1ef8-4432-b885-b2b378669908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.219386 Aug 02 09:14:11.641302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 220/398] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:12.666967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:12.667868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:12.671632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:12.676662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.677706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.681307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:12.682265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.876182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:12.885338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:12.887409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:12.888651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4029a376-5e7b-43de-a3bb-883efdf4db0a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.225733 Aug 02 09:14:12.889536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 179/399] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:13.913647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:13.917042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:13.927169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.927862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.928841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.929313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.118596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:14.129622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:14.131396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:14.132568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eb4d1982-6d6d-4185-b542-2114a3ea45e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.223463 Aug 02 09:14:14.133326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 221/400] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:15.159268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.164051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.173864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.175226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.176491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.177323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.276039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-505ca49a-7ad3-45a9-ad44-9926edc102df tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:15.294298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-505ca49a-7ad3-45a9-ad44-9926edc102df tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.296479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-505ca49a-7ad3-45a9-ad44-9926edc102df tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.362395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.384825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.390068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.391459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1935b0af-feda-43ce-8f31-2682421ee7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.236350 Aug 02 09:14:15.402400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 180/401] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:15.423337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-505ca49a-7ad3-45a9-ad44-9926edc102df tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Going to try to stop instance {{(pid=117908) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 09:14:15.471620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-505ca49a-7ad3-45a9-ad44-9926edc102df tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/action" status: 202 len: 0 microversion: 2.1 time: 0.208492 Aug 02 09:14:15.473278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 222/402] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:14:15 2022] POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:14:15.481683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.482600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.489894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.490969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.492028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.493232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.660670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.672024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d285ee3f-c138-4c54-afd1-5b10b9e426cf tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.194257 Aug 02 09:14:15.681170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 181/403] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:15 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:16.419385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.420142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.428545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.429038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.430163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.430592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.445887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:16.570645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.579586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.581164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.582328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-121f951e-9872-41c7-884e-52bfcb4cd70b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1743 microversion: 2.20 time: 0.168468 Aug 02 09:14:16.582921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 223/404] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:16.694556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.695165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.702407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.702851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.703611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.704048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.833750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.841902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0a610e0f-762c-4b6f-8230-4ac22fbabe1b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.151219 Aug 02 09:14:16.842461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 182/405] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:17.611577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:17.612207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:17.619222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.619673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.620478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.620934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.758937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:17.768284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:17.769803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:17.771057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-689bb746-a980-4e0b-aeb5-35716ff4517a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1725 microversion: 2.20 time: 0.168888 Aug 02 09:14:17.771632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 224/406] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:17.864988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:17.865654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:17.872358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.872827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.873637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.874076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.018089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.027320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9fd6a1f8-053f-482e-9275-169a6f248f34 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.166360 Aug 02 09:14:18.028091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 183/407] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:17 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:18.798002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:18.798628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:18.805379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.805824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.806601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.807030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.949720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.958473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.959979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.961505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b8aece57-4535-4f72-9ce6-06ee3e6b84a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1725 microversion: 2.20 time: 0.168159 Aug 02 09:14:18.962085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 225/408] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:19.048617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.049215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:19.055656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.056112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.056891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.057351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.061075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:19.206024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:19.214978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a4f9c12c-cda9-4a21-ae56-b04b12ec0b1c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.170278 Aug 02 09:14:19.215595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 184/409] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:19.253076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-9bc38f5d-1159-48fa-8303-6900e4caec5e req-8b221d34-500d-469a-9587-9ff4bc2f7783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "name": "network-vif-unplugged", "status": "completed", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:19.263169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-9bc38f5d-1159-48fa-8303-6900e4caec5e req-8b221d34-500d-469a-9587-9ff4bc2f7783 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.263693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-9bc38f5d-1159-48fa-8303-6900e4caec5e req-8b221d34-500d-469a-9587-9ff4bc2f7783 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.275538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-9bc38f5d-1159-48fa-8303-6900e4caec5e req-8b221d34-500d-469a-9587-9ff4bc2f7783 service nova] Creating event network-vif-unplugged:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:14:19.280865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-9bc38f5d-1159-48fa-8303-6900e4caec5e req-8b221d34-500d-469a-9587-9ff4bc2f7783 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031581 Aug 02 09:14:19.281538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 226/410] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:19.985918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.986524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:19.992504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.992954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.993838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.994258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.131972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.141078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.142609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.143781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d3f529e2-e3f8-4a54-9d45-3441404a455a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1725 microversion: 2.20 time: 0.161806 Aug 02 09:14:20.144495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 185/411] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:20.237414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:20.238144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:20.244973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.245449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.246877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.247321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.392374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.401533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0a227c6-2dd7-4901-92fd-0a8bb56d81e4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.168677 Aug 02 09:14:20.402134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 227/412] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:20 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:21.169212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.169871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.176505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.176949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.177750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.178185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.323830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.332849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.334466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.335607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-774a3bc1-9d38-4166-abad-0788159170fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1728 microversion: 2.20 time: 0.171566 Aug 02 09:14:21.336168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 186/413] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:21.362131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c837a4be-60d0-42f8-9b96-6e6a50e807d1"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:21.364573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.371912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.372361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.373170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.373611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.433068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.434642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.442305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.442747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.443521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.443954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.608066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.620574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6e4e1b5-063e-49c7-8682-f6ae47fe1bd4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.201360 Aug 02 09:14:21.622405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 187/414] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:21.736928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c87a4b32-0807-4793-9634-6dadbeefc4dd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378833 Aug 02 09:14:21.743812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 228/415] 10.222.0.100 () {62 vars in 1369 bytes} [Tue Aug 2 09:14:21 2022] POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:14:21.875347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:21.875950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.882286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.882761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.883524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.883965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.929510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117909) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:14:22.000480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-846b8d57-7773-43c7-af71-27eaf444b43e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/action" status: 202 len: 0 microversion: 2.20 time: 0.129409 Aug 02 09:14:22.001097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 188/416] 10.222.0.100 () {62 vars in 1324 bytes} [Tue Aug 2 09:14:21 2022] POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:22.010352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:22.010968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:22.017232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.017687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.018477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.018918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.172128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.183013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.184882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.186090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41b7f628-652c-4494-9696-5da8563a2116 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1754 microversion: 2.20 time: 0.179774 Aug 02 09:14:22.186661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 229/417] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:22.644820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:22.645471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:22.652142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.653220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.654073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.654519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.854509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.864794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d65a67a-25e5-4faf-bed8-7db6e5840b78 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.224295 Aug 02 09:14:22.865519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 189/418] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:22 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:23.210855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:23.212806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:23.220414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.220863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.221698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.222140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.359888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.368891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.370490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.372963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e689ea47-7123-49c7-b9dc-433b320ecce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1756 microversion: 2.20 time: 0.166032 Aug 02 09:14:23.373581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 230/419] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:23.887853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:23.888758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:23.896410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.896864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.897691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.898127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.065812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.074532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-48bf8033-8aaa-4370-908a-c5efb19c9339 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.190359 Aug 02 09:14:24.075333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 190/420] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:23 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:24.398175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:24.398789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:24.401880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=48 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:24.407229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.407681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.408465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.408912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.555845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.565422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.567117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.568311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-630a6786-b2cb-47e1-85b7-4bda4b08d4a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1756 microversion: 2.20 time: 0.174582 Aug 02 09:14:24.568880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 231/421] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:25.096653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:25.097324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:25.104203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.104601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.105448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.105910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.255325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.264303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b2484c1b-b9ec-4eba-9ea0-b971a313e96e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.171314 Aug 02 09:14:25.264892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 191/422] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:25 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:25.489014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1815945643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1502777233", "security_groups": [{"name": "tempest-secgroup-smoke-531706345"}], "networks": [{"uuid": "3d2759ea-3966-4fc1-a4cb-a839371b04f2"}], "block_device_mapping_v2": [{"uuid": "d504f346-02c3-459c-961f-cb4e828ffdda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:25.592707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:25.593457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:25.608671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.608671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.609489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] validate_networks() for [('3d2759ea-3966-4fc1-a4cb-a839371b04f2', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:14:25.609579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.609579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.744635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.755767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.757345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.758568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4503abfe-f1b1-4461-9274-7aa49e863387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.170516 Aug 02 09:14:25.759142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 192/423] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:26.025314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:14:26.025741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:14:26.026222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:14:26.026631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:14:26.027254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:14:26.037009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.037488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.038295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.038726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.056943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Getting quotas for project a6dd8f336ea44f14bfaf1c127ddbacb1. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:26.062723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Getting quotas for user 4f1e5fb6488d4478b8f4449295613e50 and project a6dd8f336ea44f14bfaf1c127ddbacb1. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:26.136946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:14:26.139119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d504f346-02c3-459c-961f-cb4e828ffdda',volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:14:26.302852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.304136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:26.307070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1368d1a8-e17e-434e-af1b-97304b3591ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.821766 Aug 02 09:14:26.307967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 232/424] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:14:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:14:26.327912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5c831891-db03-4ecc-a037-3f767b88db74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.328383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.328946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.329333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5c831891-db03-4ecc-a037-3f767b88db74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:26.330885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.332710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.408677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5c831891-db03-4ecc-a037-3f767b88db74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:26.416168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5c831891-db03-4ecc-a037-3f767b88db74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1092 microversion: 2.1 time: 0.093776 Aug 02 09:14:26.427095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 233/425] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1092 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:26.427095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633392507", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1891613438", "security_groups": [{"name": "tempest-secgroup-smoke-1569822660"}], "block_device_mapping_v2": [{"uuid": "0bcc198d-9421-4513-9692-53a38ba3c1d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7464ba98-d47e-443c-8537-aa55d4dd15fc"}]}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:26.578198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] validate_networks() for [('7464ba98-d47e-443c-8537-aa55d4dd15fc', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:14:26.634646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:26.653814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a72de37-d45a-4100-b6e1-20afcb0b76c2 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.370885 Aug 02 09:14:26.655334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 193/426] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:26 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:26.783865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.784479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:26.791493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.791939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.795060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.796306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.954755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:26.963533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:26.966530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:26.968075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-18158c1c-fb07-4e77-9f62-d88558fadff8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.188079 Aug 02 09:14:26.979638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 194/427] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:27.040821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:14:27.041483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:14:27.041959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:14:27.042367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:14:27.044032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:14:27.055329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.055775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.056582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.057015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.079681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Getting quotas for project 9a4b022cdf9c448dbb51c5ffd9212181. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:27.084868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Getting quotas for user d22a27db106e45e68444fa022d254c83 and project 9a4b022cdf9c448dbb51c5ffd9212181. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:27.191914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:14:27.195128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bcc198d-9421-4513-9692-53a38ba3c1d8',volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:14:27.432810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3ba5dcdd-b3ad-4a5a-9e66-f685a12a7cef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.013454 Aug 02 09:14:27.434532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 234/428] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:14:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:14:27.453351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.456586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.471102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-338b397f-b8e3-4749-bca3-0d563a08daed tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.472816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-338b397f-b8e3-4749-bca3-0d563a08daed tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.498777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.504986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.506153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.506747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.599160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-338b397f-b8e3-4749-bca3-0d563a08daed tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.616506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-338b397f-b8e3-4749-bca3-0d563a08daed tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1097 microversion: 2.1 time: 0.162947 Aug 02 09:14:27.618604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 235/429] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1097 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:27.650947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:27.664823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fbf1d549-7da5-4b82-8646-d93b0ad9d769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.221537 Aug 02 09:14:27.666567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 195/430] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:27.703943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.710349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.724672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.725159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.726213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.726827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.993984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.994594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.001282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.010787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e0debe9-d75e-4bc7-8267-51eb753cfda7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.323263 Aug 02 09:14:28.013062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 236/431] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:28.029372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.030289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.032591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.033776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.232442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.243641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.247602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.249699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d83786a-3d3c-45cf-8cea-815207e52af7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.259388 Aug 02 09:14:28.250616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 196/432] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:28.640943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:28.641773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.648530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.648969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.649767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.650195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.704127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:28.705537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.721746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.722495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.723628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.724375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.741279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.750163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0906356-eb1e-43dd-a2b3-e589e6ae99ba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.113984 Aug 02 09:14:28.751340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 237/433] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:28 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:28.798335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:28.805862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-75317576-83fe-4c62-bb5c-b5739ba77893 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.107604 Aug 02 09:14:28.806431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 197/434] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:29.035188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.035834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.043133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.043606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.044405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.044850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.210005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.219924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe2826c1-7f7c-4ef3-a720-bd5f85d4a633 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.189150 Aug 02 09:14:29.227420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 238/435] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:29.277604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.278513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.285821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.286275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.287089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.287557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.390018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c3324ae-90c8-4c69-920f-63141b54c5e5", "device": "/dev/sdb"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:29.392993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.399332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.399772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.400542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.400979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.440328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.453782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.455213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.456431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ebb9be9b-7699-432f-87c4-4934d0a3d52c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.185976 Aug 02 09:14:29.470348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 198/436] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:29.772205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.772956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.779560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.780014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.780818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.781296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.844515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.846730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:29.853452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-09d8d75f-c71e-4538-aa89-48b626e45aad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.085076 Aug 02 09:14:29.854039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 199/437] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:29.860718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:29.861359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:29.868515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.868999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.869816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:29.870254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.934703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:29.942803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1adbbb3c-dda1-427f-82a7-64f626cb2d35 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.087543 Aug 02 09:14:29.956716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 200/438] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:30.243768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.244388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.250926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.251379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.252169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.252611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.401326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:30.410216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e06080b1-602b-4788-8fe6-b7560c2367c7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.170346 Aug 02 09:14:30.410784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 201/439] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:30.482279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.482852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.492646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.493123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.493938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.494374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.647906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:30.657932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:30.659488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:30.660654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d217f33d-16fa-4dd0-bd9e-c63b57661a1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.183084 Aug 02 09:14:30.661228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 202/440] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:30.874853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.875573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.882396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.882856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.883633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.884077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.950296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:30.957901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e8bd7cc-8dd6-40cc-9dfd-2e2a491753a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.087451 Aug 02 09:14:30.958680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 203/441] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:30.965675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.966337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.972564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.973020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.973924 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.974361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.038800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.047717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-414c2b45-2146-45ad-8d31-e71ff987af57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.087151 Aug 02 09:14:31.048329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 204/442] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:31.431720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:31.432337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:31.439101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.439558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.440338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.440777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.582381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.592240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ffc6baf5-8797-4dc2-b4ff-b4bc37d219b3 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.164373 Aug 02 09:14:31.603309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 205/443] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:31 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:31.683571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:31.684458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:31.690511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.690959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.691723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.692154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.828879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.837537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.839064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:31.840928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ec657cfb-e6f2-4e6d-ac83-a9590e52dcba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.161439 Aug 02 09:14:31.841518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 206/444] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:31.979163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:31.980019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:31.986914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.987369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.988154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.988596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.057777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.065705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a2c77e2b-5dc8-496b-8a7d-a117546110e8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.090310 Aug 02 09:14:32.066288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 207/445] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:31 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:32.070968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.071575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.078298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.078681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.079458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.079896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.153871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.162641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a3dfe42-8a7a-40ab-83eb-b6e338182468 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.095225 Aug 02 09:14:32.164292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 208/446] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:32.614406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.615055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.621409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.621858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.622627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.623065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.779723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:32.789331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1aa71a17-d94e-469a-b6d8-0f7bde9f78f5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.178639 Aug 02 09:14:32.789918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 209/447] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:32.870153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.870784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.879362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.880286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.881127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.881713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.036861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.045580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.047107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.048284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-873225bb-0394-47ea-925d-dc7123674f79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.183209 Aug 02 09:14:33.048855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 210/448] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:33.087151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.087771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.094123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.094581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.095364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.095804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.165654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.175085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5d22aba9-60b0-426c-a00b-311b45c81e02 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.091656 Aug 02 09:14:33.175887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 211/449] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:33.192852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.193940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.201885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.202331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.203109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.203554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.268138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.275787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a397e41-2883-44fa-800b-54af49a36e42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.089820 Aug 02 09:14:33.276355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 212/450] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:33.811236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.811844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.817797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.818251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.819019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.819462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.967149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:33.975415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a3eb26e-fbd3-448a-9104-eea251106485 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.168056 Aug 02 09:14:33.976000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 213/451] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:34.077435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.078870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.092149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.093052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.094584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.095543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.272336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.281975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.283493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.284709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1444009a-1538-485c-96da-e038de9c6c04 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.216039 Aug 02 09:14:34.302465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 214/452] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:34.302465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.302465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.302465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.302973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.302973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.302973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.368527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.378034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e1804c8-42db-4129-89d2-1006bcbfdaf8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.090644 Aug 02 09:14:34.378625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 215/453] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:34.395064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.396362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.404962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.405595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.406483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.407034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.424895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:34.474298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:34.483337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-06cdf7db-c687-4ea2-90b9-28590f324d1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.092626 Aug 02 09:14:34.484394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 216/454] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:34.998469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.999083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.005471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.005919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.006684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.007139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.148968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.177392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-208c4686-6a78-4515-a45c-5536bed36972 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.183401 Aug 02 09:14:35.178264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 217/455] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:35.310510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.311227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.318392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.319069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.319863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.320305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.469369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.477727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.479264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.481061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c397ebb-f919-4599-8fb8-6264e4e1fc64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.174684 Aug 02 09:14:35.481641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 218/456] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:35.486225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.486832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.493009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.493503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.494267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.494704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.571346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.580857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-74a5819e-5afb-4c74-885f-95ad42799bd8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.098174 Aug 02 09:14:35.581916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 219/457] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:35.586679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.587751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.594893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.597714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.598636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.599150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.662539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.670234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c58e7eb9-d5a0-434e-9495-1598eb207a3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.087250 Aug 02 09:14:35.670813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 220/458] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:36.199479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.200249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.206981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.207447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.208237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.208680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.361647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.379361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d92bb125-a86e-4b0a-a205-6954c1103dc4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.183476 Aug 02 09:14:36.383957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 221/459] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:36.505206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.505935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.512697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.513499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.514391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.515148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.662313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.675056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.677601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.681202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2164482b-fa06-4238-8e14-eeea14e7e3e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.178288 Aug 02 09:14:36.681202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 222/460] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:36.686365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.686997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.693953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.694402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.695710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.696151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.770499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.778784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c68de05c-9c4a-4e55-9f1f-6517cdfd3f57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.096799 Aug 02 09:14:36.779595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 223/461] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:36.783823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.784432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.790300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.790756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.791533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.791974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.860074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.867905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-344603ce-0b3f-444c-add8-559523d6fe25 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.087518 Aug 02 09:14:36.868484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 224/462] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:37.067338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:37.408469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:37.408469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:37.417087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.417677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.418634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.419066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.575819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.584380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-34fea9f0-ad17-439b-bbbf-986866b2ba95 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.185196 Aug 02 09:14:37.585154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 225/463] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:37 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:37.609629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=16 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:37.703796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:37.704553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:37.707751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:37.712295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.712835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.713721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.714305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.861823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.871967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.875881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.878100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-849a5f5c-d2cc-4e5b-9733-aef5b3cba1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.178005 Aug 02 09:14:37.884676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 226/464] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:37.898464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:37.899093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:37.916373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.916836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.918240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.918744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.000289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.010385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c61ebc3f-6b74-42ab-8f3d-137f4c43d886 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.124714 Aug 02 09:14:38.012146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 227/465] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:37 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:38.017068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.018073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.025010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.025755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.027632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.028277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.098555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.108144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-67b63e70-1162-433e-b76d-e840ff868cee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.094717 Aug 02 09:14:38.108738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 228/466] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:38.605345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.606073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.612475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.612930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.613738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.614179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.753233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.762115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d29cf72-933a-420e-8c84-c5f1edb7cbe7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1726 microversion: 2.1 time: 0.160899 Aug 02 09:14:38.762694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 229/467] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:38.909333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.909975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.916286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.916737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.917830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.918270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.047857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.056256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.058501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.059695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-641d1fbd-6123-4a97-bb20-42abc4db0e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.154600 Aug 02 09:14:39.060331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 230/468] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:39.064764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.065391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.071221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.071667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.072427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.072854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.138857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.146579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-55a96dee-4f99-434b-b935-f8902ea948b2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1147 microversion: 2.1 time: 0.085254 Aug 02 09:14:39.147154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 231/469] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1147 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:39.151783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.152384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.159530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.159990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.160774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.161240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.225446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.233769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8757b1fd-3225-4f2e-a731-e1edbe972117 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1190 microversion: 2.1 time: 0.085625 Aug 02 09:14:39.234383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 232/470] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1190 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:39.397218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:39.523775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:39.784362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.784984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.791795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.792489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.793327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.793788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.798145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:39.936026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.944125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62852ecd-d459-4ff1-89ec-57143b7d5a71 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1703 microversion: 2.1 time: 0.164800 Aug 02 09:14:39.944704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 233/471] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1703 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:39.969691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8e94c52f-2935-4bce-98ef-fae4bc04bf69 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:39.971784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e94c52f-2935-4bce-98ef-fae4bc04bf69 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.972242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e94c52f-2935-4bce-98ef-fae4bc04bf69 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.037496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8e94c52f-2935-4bce-98ef-fae4bc04bf69 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Going to try to start instance {{(pid=117909) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 09:14:40.092360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8e94c52f-2935-4bce-98ef-fae4bc04bf69 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/action" status: 202 len: 0 microversion: 2.1 time: 0.130938 Aug 02 09:14:40.092964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 234/472] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:14:39 2022] POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:14:40.098050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.098737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:40.106204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.107072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.108146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.108635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.250115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.258849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.260380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.261981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f7520a4-7d21-4e00-9034-fd3b923cdc3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.167756 Aug 02 09:14:40.262735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 235/473] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:40.267249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.267934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:40.277647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.278109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.280450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.280903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.439852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.452487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfcdfac3-c714-4ca7-8428-9b068571e75a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1712 microversion: 2.1 time: 0.188053 Aug 02 09:14:40.453502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 236/474] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1712 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:40.458320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.459075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:40.467149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.467731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.468652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.469202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.525446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff0a0c4e-0f2d-4975-940b-eb0db6d3d69f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "POST /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.140068 Aug 02 09:14:40.526075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 239/475] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:14:29 2022] POST /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments => generated 194 bytes in 11142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:40.538352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.539178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:40.547164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.547616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.548393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.548824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.602884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.610826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d403d22f-fd3d-41ef-a232-f4b21642527b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1195 microversion: 2.1 time: 0.156302 Aug 02 09:14:40.611403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 237/476] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1195 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:40.618399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:40.627205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d445660-cc88-4a19-b63d-875070474cb6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1208 microversion: 2.1 time: 0.093573 Aug 02 09:14:40.627802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 240/477] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1208 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:41.295738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:41.296612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.303662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.304204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.304938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.305443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.475253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:41.475905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.484353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.484808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.485617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.486057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.523812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.533973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.535486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.536660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2f393044-b606-41ef-a928-0bb03b5411fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.246397 Aug 02 09:14:41.537237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 238/478] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:41.623393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.632648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:41.633354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.638237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-144e946a-1926-4e53-a2c2-7893f004ba63 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1712 microversion: 2.1 time: 0.166481 Aug 02 09:14:41.639666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 241/479] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:41 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1712 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:41.646148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.646569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.648218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:41.648841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.654523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.656341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.660680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.661592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.662809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.663446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.756939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.767924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eac7df89-cebc-4618-86eb-f90a69f04113 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1208 microversion: 2.1 time: 0.124032 Aug 02 09:14:41.768833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 242/480] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:41.801962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.809960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-20dd6ac0-34ab-4e12-a76b-a5f12b2eec3d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1195 microversion: 2.1 time: 0.181928 Aug 02 09:14:41.810858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 239/481] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:41 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1195 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:42.562526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.563174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.570398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.571022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.571755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.572194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.665649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.666410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.680588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.680785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.681665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.681956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.744896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.755557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.758061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.759406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2ded94a0-0817-4983-8d80-7f3159abf555 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.202863 Aug 02 09:14:42.774972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 243/482] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:42.797179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.797766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.804902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.805435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.806219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.806706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.873693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.887146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a5e53a67-c86c-47c8-ab0e-97c8c27fafd7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1712 microversion: 2.1 time: 0.225921 Aug 02 09:14:42.887757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 240/483] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1712 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:42.893648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.894572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.902456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.902928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.903720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.904157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.981968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.983506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.992290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb4241e0-05d6-469e-b1fd-18eefde50ad1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.200659 Aug 02 09:14:42.992606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5bd716bc-966a-4876-aef3-fb64ad1e2860 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1213 microversion: 2.1 time: 0.101551 Aug 02 09:14:42.992900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 244/484] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:42.993794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 241/485] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:43.785790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:43.786543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:43.794752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.795452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.796553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.796835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.911301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:43.912520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:43.931001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.931457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.932241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.933441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.969175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:43.978871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:43.981157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:43.982758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5425887-6440-4343-ae6e-c5cc0354e565 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.201655 Aug 02 09:14:43.988877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 245/486] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:44.014811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:44.015675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:44.021637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.022410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.023477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.024757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.106050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.114218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-84b68216-61da-4e18-8a10-0736a1196f4e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1213 microversion: 2.1 time: 0.103156 Aug 02 09:14:44.125640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 246/487] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:44.125640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:44.125640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:44.135162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.135727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.136790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.137319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.286149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.294755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-376a9277-0974-4fc9-b940-5be998740d8d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.178364 Aug 02 09:14:44.295621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 247/488] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:44.336496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.345519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0cdc82c3-97e1-4f87-94b8-69723e395d79 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1712 microversion: 2.1 time: 0.439609 Aug 02 09:14:44.346409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 242/489] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:43 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1712 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:44.541274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-a6097043-8a6b-428b-9bf8-7561f0316345 req-6542f95c-672a-4331-af2e-81310f84ac55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64272d61-0647-41fa-960d-d71df9c72c70", "tag": "86db858b-f033-44df-ba65-35bb43a0e045"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:44.551732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a6097043-8a6b-428b-9bf8-7561f0316345 req-6542f95c-672a-4331-af2e-81310f84ac55 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:44.552188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a6097043-8a6b-428b-9bf8-7561f0316345 req-6542f95c-672a-4331-af2e-81310f84ac55 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:44.563782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-a6097043-8a6b-428b-9bf8-7561f0316345 req-6542f95c-672a-4331-af2e-81310f84ac55 service nova] Creating event network-changed:86db858b-f033-44df-ba65-35bb43a0e045 for instance 64272d61-0647-41fa-960d-d71df9c72c70 on hv-cinder-80382 Aug 02 09:14:44.568614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-a6097043-8a6b-428b-9bf8-7561f0316345 req-6542f95c-672a-4331-af2e-81310f84ac55 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031166 Aug 02 09:14:44.569251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 248/490] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:45.007875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.008583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.016232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.016774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.017650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.018151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.142335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.143105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.149601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.150055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.150850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.151282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.232590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.242325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.250277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.251828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-af367d8d-d8c6-40dd-b39f-3bdc7de26a7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.248182 Aug 02 09:14:45.257386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 243/491] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:45.303323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.315591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.315833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8d0a1d0-f258-48fe-95d4-46c22febb1d1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.178082 Aug 02 09:14:45.316361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.322973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.323433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.324325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.324769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.329531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 249/492] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:45.368059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.371013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.375611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.376064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.376853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.377326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.533195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.542300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5909c412-32ef-4e09-83f5-dd84a31fd7d1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1712 microversion: 2.1 time: 0.177858 Aug 02 09:14:45.543436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 250/493] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1712 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:45.549816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-2a8833b1-73c5-4e40-8c7d-088169db6ff6 req-b4a9c62d-e844-46ed-a9a0-851e3f6b006a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "name": "network-vif-plugged", "status": "completed", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:45.556487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.563306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-2a8833b1-73c5-4e40-8c7d-088169db6ff6 req-b4a9c62d-e844-46ed-a9a0-851e3f6b006a service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.564166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-2a8833b1-73c5-4e40-8c7d-088169db6ff6 req-b4a9c62d-e844-46ed-a9a0-851e3f6b006a service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.565387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88eb38bc-a4a7-427d-b38a-d0542618c8c3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.253459 Aug 02 09:14:45.566367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 244/494] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:45.580343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-2a8833b1-73c5-4e40-8c7d-088169db6ff6 req-b4a9c62d-e844-46ed-a9a0-851e3f6b006a service nova] Creating event network-vif-plugged:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:14:45.586643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-2a8833b1-73c5-4e40-8c7d-088169db6ff6 req-b4a9c62d-e844-46ed-a9a0-851e3f6b006a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040452 Aug 02 09:14:45.587262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 251/495] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:46.276072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:46.277507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:46.284114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.284575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.285491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.285933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.336863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:46.337714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:46.344600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.345149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.346013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.346446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.415564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:46.424852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:46.426325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:46.427515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6654c929-8f8a-4a4d-8e0b-420eb7c73e6b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.155463 Aug 02 09:14:46.428081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 245/496] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:46.484147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:46.491664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c373785b-0e26-4993-ba69-8436c4384991 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.159523 Aug 02 09:14:46.492242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 252/497] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:46.564595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:46.565257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:46.571496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.571952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.572716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.573874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.585303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-4536ce5d-9532-4b81-b96f-e47d37b9153a req-bb91d722-5e6b-4f50-adc9-2b6673231db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740332a9-5b49-41cf-9db1-ec96264ed7fd", "tag": "87c73e63-4764-4978-b58d-e5e8146a5f51"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:46.594677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-4536ce5d-9532-4b81-b96f-e47d37b9153a req-bb91d722-5e6b-4f50-adc9-2b6673231db3 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.595122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-4536ce5d-9532-4b81-b96f-e47d37b9153a req-bb91d722-5e6b-4f50-adc9-2b6673231db3 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.606703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-4536ce5d-9532-4b81-b96f-e47d37b9153a req-bb91d722-5e6b-4f50-adc9-2b6673231db3 service nova] Creating event network-changed:87c73e63-4764-4978-b58d-e5e8146a5f51 for instance 740332a9-5b49-41cf-9db1-ec96264ed7fd on hv-cinder-80382 Aug 02 09:14:46.611766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-4536ce5d-9532-4b81-b96f-e47d37b9153a req-bb91d722-5e6b-4f50-adc9-2b6673231db3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030006 Aug 02 09:14:46.612840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 253/498] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:46.618257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:46.618957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:46.626166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.626614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.627396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.627838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.786668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:46.799686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb012ae5-5f51-4cbe-abeb-f29a32084cc9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.185086 Aug 02 09:14:46.801033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 254/499] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:47.209811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:47.219020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5b35a314-dc2f-401f-a363-77dbd9cf1496 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1716 microversion: 2.1 time: 0.658173 Aug 02 09:14:47.219624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 246/500] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:46 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1716 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:47.451977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:47.452591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:47.459245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.459691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.460468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.460901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.513633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:47.514380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:47.521206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.521655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.522426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.522855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.606531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:47.615104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:47.616586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:47.617788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-04cb20b8-1b8d-4364-8ac9-0c0ac90fe8d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.170147 Aug 02 09:14:47.618357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 255/501] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:47.668341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:47.675788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-34c56135-bc4f-45e4-94d2-57d8bbf223f1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.166502 Aug 02 09:14:47.676349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 247/502] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:47 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:47.823940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:47.824764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:47.830747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.831200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.831963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.832396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.965422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:47.972974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-23ee5e96-aada-4f57-97f5-b3b0b30aaf44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.153656 Aug 02 09:14:47.973589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 256/503] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:48.641407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:48.642044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:48.649151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.649604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.650454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.650803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.695648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:48.696261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:48.702598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.703046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.703817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.704251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.708663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:48.786890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:48.789263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:48.798477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:48.799986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:48.801185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b54d1261-444d-4591-9104-2714fddbeab1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.163730 Aug 02 09:14:48.801750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 248/504] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:48.843854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:48.851269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-630d0875-1b83-4e04-bb18-298f8623b169 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.159405 Aug 02 09:14:48.851837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 257/505] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:48.993876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:48.994480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:49.002381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.002826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.003583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.004012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.132769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:49.140976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5143f6bf-a1f7-4fdd-8e2a-d53144dfc89c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.150886 Aug 02 09:14:49.141576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 249/506] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:49.826193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:49.826842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:49.833922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.834396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.835236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.835702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.872539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:49.873171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:49.880122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.880571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.881382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.881813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.971190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:49.980369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:49.981923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:49.983153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6b9e094f-e2dc-4a24-b4b3-3603e0176ed6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1812 microversion: 2.20 time: 0.161391 Aug 02 09:14:49.983722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 258/507] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:50.017718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:50.025241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3956d54c-533d-4cf7-a918-4fdd60f96678 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.157304 Aug 02 09:14:50.025887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 250/508] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:50.162299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:50.162916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:50.169865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.170316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.171522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.171522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.299828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f59cf3bd-aa15-4cf1-8779-3026a2361965"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:50.302303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:50.308742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.309218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.309681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:50.310056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.310596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.317651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b13fed4-2a2f-4756-9ae5-f238ae6c51ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.159205 Aug 02 09:14:50.318221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 259/509] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:50.846625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-43cc7e5a-e616-49fb-aae8-c56b436edb20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550594 Aug 02 09:14:50.848000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 251/510] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:14:50 2022] POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:51.007727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:51.008342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:51.015616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.016067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.016843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.017349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.047565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:51.048531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:51.054970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.055420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.056185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.056781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.163107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:51.172184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:51.173768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:51.175089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-28eb1ec6-9968-4496-87a0-b6f410095445 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1799 microversion: 2.20 time: 0.171658 Aug 02 09:14:51.175739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 260/511] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:14:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1799 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:51.254187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:51.262956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f46d67ec-1e28-43ca-93b1-d7aaee2b6eb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.220180 Aug 02 09:14:51.263545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 252/512] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:51.338937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:51.339637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:51.345823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.346354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.347195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.347705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.492647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:51.501627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8f53f3e-93f5-48e7-8c2e-928f6f0a3616 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1275 microversion: 2.1 time: 0.166775 Aug 02 09:14:51.510329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 261/513] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:52.283509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:52.284124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:52.291709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.292290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.293076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.293537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.425551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:52.434552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f47c61b2-7213-4613-ae3c-18fb4be8dd88 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.154974 Aug 02 09:14:52.435161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 253/514] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:52.526823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:52.527619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:52.535153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.535542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.536331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.536901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.671668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:52.679242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ccc0e121-aa73-457a-80a6-9ae0b57735d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.156535 Aug 02 09:14:52.679810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 262/515] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:53.456735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:53.457375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:53.464216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.464676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.465471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.465903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.614418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:53.622490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-43a36a1c-4623-4214-8730-7a89709f3255 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.169759 Aug 02 09:14:53.623074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 254/516] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:53 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:53.700873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:53.701515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:53.708120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.708511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.709306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.709742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.857141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:53.864505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1bf42834-1c28-4bd8-811a-928544362603 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.168197 Aug 02 09:14:53.865215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 263/517] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:54.652594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:54.653390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:54.660023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.660480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.661291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.661729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.790785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:54.798345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b85cc92b-53fc-4cc7-9dd3-1dce86587c73 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1281 microversion: 2.1 time: 0.150188 Aug 02 09:14:54.798918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 255/518] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1281 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:54.887985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:54.888547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:54.895086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.895524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.896323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.896939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.037606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:55.045619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-17afbd50-ee40-4ae7-a048-cf0157b7a5d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.163071 Aug 02 09:14:55.046271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 264/519] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:55.820098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:55.820672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:55.828386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.829035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.829743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.830184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.966545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:55.974230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15b00aa3-b6e9-4d5b-bb18-49585274ff17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.158458 Aug 02 09:14:55.974796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 256/520] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:56.067879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:56.068407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:56.075476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.075919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.076680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.077132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.217740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:56.225187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cba56164-1e59-4ebc-bca7-28601a350ab3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.161189 Aug 02 09:14:56.225762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 265/521] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:56.995180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:56.996071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:57.002565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.003027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.003793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.004240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.133676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.141140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-29f752c7-5bd0-428f-bb27-35fde3291d4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.149862 Aug 02 09:14:57.141711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 257/522] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:57.246392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:57.247175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:57.253783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.254239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.255284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.255722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.387074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.395390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e44dd2c1-6bd8-41ab-a14d-c10ca64f238f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.152949 Aug 02 09:14:57.395974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 266/523] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:58.162440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:58.163037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:58.170258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.170711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.171480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.171929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.305220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:58.313733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-29b9acd1-af26-42b9-8091-39b4518ab44d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.155134 Aug 02 09:14:58.314313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 258/524] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:58.416530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:58.417733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:58.424414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.424865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.425664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.426106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.557426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:58.565103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-467f085b-91fd-45d1-a727-c9e98cc37979 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.152508 Aug 02 09:14:58.565699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 267/525] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:59.334395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:59.335013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:59.342020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.342646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.343436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.343876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.488836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:59.497373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f9caff78-3daa-441b-b680-a16fd62ca14c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.166772 Aug 02 09:14:59.497953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 259/526] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:59.586744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:59.587331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:59.594155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.594619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.595374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.595805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.736587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:59.744460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-53a6873e-6c26-4e41-a472-79dddd07780b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.161995 Aug 02 09:14:59.745659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 268/527] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:14:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:00.519263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:00.519869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:00.527147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:00.527603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:00.528383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:00.528823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:00.676342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:00.687305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fa69af54-b7dd-41bb-9d4e-7dc8008321ea tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.171834 Aug 02 09:15:00.687879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 260/528] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:00 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:00.766769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:00.767425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:00.775076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:00.775412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:00.776194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:00.776640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:00.910160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:00.918443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-24661d2a-b4a0-46aa-b656-37e34623e273 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155965 Aug 02 09:15:00.919091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 269/529] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:01.708926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:01.709590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:01.716671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.717150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.717928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.718374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.850790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:01.858786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-008c7ac4-94d9-4212-9fed-118278f8a61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.153901 Aug 02 09:15:01.859349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 261/530] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:01 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:01.948458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:01.949083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:01.955843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.956298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.957073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.957544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:02.092700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:02.100185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c97c614-bf33-4431-9307-358ee6df5d05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.156221 Aug 02 09:15:02.100754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 270/531] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:02.885160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:02.886566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:02.893635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:02.894084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:02.894865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:02.895301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.031209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:03.038581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21c5a2ff-f217-4602-8892-146a52928646 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.162662 Aug 02 09:15:03.039151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 262/532] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:03.121444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:03.122060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:03.128604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.129055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.130115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.130554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.266995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:03.274394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2602ec80-a726-449b-9b70-e0dcfaa07162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.156878 Aug 02 09:15:03.274958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 271/533] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:04.059896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:04.060513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:04.066991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.067444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.068216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.068656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.202311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.209796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-711d2bf7-9923-4579-98df-c29eb921aaca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.153902 Aug 02 09:15:04.210361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 263/534] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:04.295624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:04.296317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:04.302813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.303255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.304009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.304436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.439878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.447540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b44f1f2c-1420-4c47-8839-92ad8322bf22 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155808 Aug 02 09:15:04.448792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 272/535] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:05.231288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:05.231851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:05.238341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.238789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.239551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.239986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.242656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:05.375790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:05.383477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-75d30bc3-67b4-4b4a-8fc5-480fb0fb4233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.156154 Aug 02 09:15:05.384043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 264/536] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:05 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:05.469238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:05.470002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:05.476432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.476876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.477677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.478165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.607579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:05.611054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:05.615428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f6b7d05-ff0d-4054-a7d6-5f61671ad885 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.150256 Aug 02 09:15:05.616040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 273/537] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:06.404478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:06.405091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:06.411603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.412051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.412817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.413290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.547766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.555367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8755eb40-6b03-48af-b93d-ec2d912a7c0d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.155269 Aug 02 09:15:06.555868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 265/538] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:06.637420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:06.638065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:06.644921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.645388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.646147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.646579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.779226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.786798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf3a30fe-0411-4030-be33-84655af232d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.153798 Aug 02 09:15:06.787272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 274/539] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:07.575808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:07.576461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:07.583036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.583433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.584200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.584639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.721226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.728506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b193fe65-d90c-4d73-ae42-d9aa4de478fc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.156593 Aug 02 09:15:07.729270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 266/540] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:07.807941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:07.808550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:07.815061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.815502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.816257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.816685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.952061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.959726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b0c54d0c-e230-4333-8593-3b3338a47ea2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155737 Aug 02 09:15:07.960299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 275/541] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:08.750864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:08.751438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:08.753831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=81 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:08.759262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.759714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.760615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.761056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.898268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:08.906740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ac235aaf-c0a3-42f5-a63c-8c6abe414003 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.159738 Aug 02 09:15:08.913158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 267/542] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:08 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:08.981505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:08.982115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:08.988728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.989212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.989979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.990407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.120016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:09.127747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4e63851a-b319-4b7e-92d5-7d5a3af8e11f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.150776 Aug 02 09:15:09.128315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 276/543] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:09.931175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:09.931787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:09.938812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:09.939254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.940009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:09.940437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.070599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:10.079044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d6881c66-08c2-4a53-8418-d28f339d4a63 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.151630 Aug 02 09:15:10.079633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 268/544] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:09 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:10.148822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.149479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.152996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=75 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:10.155838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.156338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.157024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.157508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.158294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.158732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.162329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.163002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.163766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.164199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.187732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9e9ee77d-96b6-4981-afe2-fca187a8dd67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/ips" status: 200 len: 151 microversion: 2.1 time: 0.035771 Aug 02 09:15:10.188633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 269/545] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:15:10 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:10.201351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef39c29f-d8cc-4b8d-9e22-89a2668d8edb"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:10.203823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.210136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.210595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.211373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.211818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.299750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Invalid volume: volume ef39c29f-d8cc-4b8d-9e22-89a2668d8edb is already attached to instances: 02e2d9a6-78b8-4f7a-8216-490f423ba511 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: POST /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/os-volume_attachments HTTP/1.1 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 74 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:15:10.301798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {"volumeAttachment": {"volumeId": "ef39c29f-d8cc-4b8d-9e22-89a2668d8edb"}} Aug 02 09:15:10.303167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: volume ef39c29f-d8cc-4b8d-9e22-89a2668d8edb is already attached to instances: 02e2d9a6-78b8-4f7a-8216-490f423ba511 Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': 'ddaf95ef-cb6f-4ed0-a20d-a4df82191123', 'body': {'volumeAttachment': {'volumeId': 'ef39c29f-d8cc-4b8d-9e22-89a2668d8edb'}}} Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef39c29f-d8cc-4b8d-9e22-89a2668d8edb is already attached to instances: 02e2d9a6-78b8-4f7a-8216-490f423ba511 Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:10.303942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef39c29f-d8cc-4b8d-9e22-89a2668d8edb is already attached to instances: 02e2d9a6-78b8-4f7a-8216-490f423ba511 Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:10.305142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef39c29f-d8cc-4b8d-9e22-89a2668d8edb is already attached to instances: 02e2d9a6-78b8-4f7a-8216-490f423ba511 Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 400 to user: Invalid volume: volume ef39c29f-d8cc-4b8d-9e22-89a2668d8edb is already attached to instances: 02e2d9a6-78b8-4f7a-8216-490f423ba511 {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c7344fd-1e66-4043-93a7-1f30fb3fe55c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106500 Aug 02 09:15:10.306382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 270/546] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:15:10 2022] POST /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:15:10.313242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.313688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.317163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:10.321888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.322343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.323179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.324236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.325548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9f9cad4c-9ada-4128-ac1a-df2a755bccb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.180479 Aug 02 09:15:10.326127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 277/547] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:10.352333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:15:10.439801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-90d288d7-b7f5-4200-8d6e-51b244c180ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 204 len: 0 microversion: 2.1 time: 0.130210 Aug 02 09:15:10.440375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 271/548] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:15:10 2022] DELETE /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:15:10.448570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.449213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.455858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.456304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.457064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.457543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.585463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:10.593620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9f703008-b114-4759-b382-8a5926e567bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.149015 Aug 02 09:15:10.594192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 278/549] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:10 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:11.100631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:11.101355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:11.107903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.108355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.109138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.109574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.239183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.247414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fa63070b-3a64-4f24-aaf7-a0268925a43b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.151001 Aug 02 09:15:11.247983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 272/550] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:11 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:11.346018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:11.346639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:11.353249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.353711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.354605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.355047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.489593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.497548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9893a1b7-f125-4a92-ab24-0ac27fb329a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155432 Aug 02 09:15:11.498149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 279/551] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:11.614571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:11.615179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:11.621828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.622272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.623024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.623525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.756096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.763955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-402a34db-d010-45d1-b58f-a214f8dc8612 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.153267 Aug 02 09:15:11.764520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 273/552] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:11 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:12.268891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.269538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.275542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.276574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.277392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.277798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.409430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.417201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5f4af652-7ea7-454c-8c6d-46765bbbcaaa tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.152000 Aug 02 09:15:12.417775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 280/553] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:12.518863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.519477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.526473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.526959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.527722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.528161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.659483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.666915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5544e84f-65db-4353-b89c-2c980d0c9211 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.151826 Aug 02 09:15:12.667473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 274/554] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:12.785378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.786001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.791978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.792417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.793312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.793747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.922348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.929917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a83cbab5-1941-45cb-9b0e-ba60c48df0e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.148826 Aug 02 09:15:12.930486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 281/555] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:13.438038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.438573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.444712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.445198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.445967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.446407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.582310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.589588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e408b625-7942-43e5-8d30-84b3f0c7dc0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.155492 Aug 02 09:15:13.590267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 275/556] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:13.687645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.688309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.694800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.695247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.696006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.696444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.829837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.837324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33b14696-b803-40a1-af6a-f34004978952 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.153560 Aug 02 09:15:13.837896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 282/557] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:13.951881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.952434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.958452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.958904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.959670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.960110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.085835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:14.093446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0f15e614-d2cc-46f8-82ca-23e4495f9bdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.145458 Aug 02 09:15:14.094013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 276/558] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:14.610057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:14.610680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:14.616525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.616967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.617751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.618180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.746329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:14.753909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e6f6bc28-f962-4ee4-8926-44a9d56114d7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.147696 Aug 02 09:15:14.754748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 283/559] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:14 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:14.857223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:14.857743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:14.864134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.864577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.865370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.865800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.996691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.004175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13505215-8db4-4edc-84f9-e93c04897de4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.151068 Aug 02 09:15:15.005004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 277/560] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:15.115322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:15.115864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:15.122765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.123218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.123989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.124427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.253545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.261993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a4f0ca00-3831-4056-ae74-b953b75aab89 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.150659 Aug 02 09:15:15.262577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 284/561] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:15 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:15.775286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:15.776595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:15.782592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.783044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.783811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.784248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.915481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.923650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff66ed96-0003-4ca4-bf67-17eb6f3721e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.152237 Aug 02 09:15:15.924217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 278/562] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:15 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:16.025422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.026649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.033287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.033741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.034515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.034955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.163107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.171080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a88e3e52-4e00-4ee1-b2f3-7c5fe1a69510 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.149679 Aug 02 09:15:16.171643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 285/563] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:16.283592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.284204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.290362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.290919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.291695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.292347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.307806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:16.423784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.431200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e524715b-8ab1-4848-b3f3-7abd34395280 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.151639 Aug 02 09:15:16.432255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 279/564] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:16.943819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.944432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.950553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.951004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.951765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.952201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.081357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:17.088762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-03845103-c3ad-45ae-afcd-bf87818d215f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.148861 Aug 02 09:15:17.089377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 286/565] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:17.191517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:17.192034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:17.198580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.199022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.199782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.200211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.330917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:17.339082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-77a852f6-c06d-4b41-8655-1d235deea602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.151214 Aug 02 09:15:17.339650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 280/566] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:17.454198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:17.454791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:17.460776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.461256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.462021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.462459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.591752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:17.599300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-061209a0-cd73-4316-9b53-9b8d0a43af52 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.149253 Aug 02 09:15:17.599875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 287/567] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:17 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:18.109681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:18.110293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:18.116296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.116744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.117534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.117968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.252031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.260511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-403aa445-8549-471e-abd1-ed9f5a0da768 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.154013 Aug 02 09:15:18.261078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 281/568] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:18 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:18.359866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:18.360389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:18.366884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.367334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.368111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.368551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.501943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.510292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0f67d190-2c89-4947-9b2c-795b64ff7a1f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.153759 Aug 02 09:15:18.510881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 288/569] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:18.621254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:18.621785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:18.627713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.628154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.628898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.629612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.762059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.769502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e4c3ac0b-9e98-4f1a-b5e6-fb2d22d00f4b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.152408 Aug 02 09:15:18.770078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 282/570] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:18 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:19.280806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.281463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.287563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.288007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.288756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.289221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.421681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.429432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-173cfddc-766e-4155-9f5e-04acfcc13e6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.152522 Aug 02 09:15:19.430011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 289/571] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:19.531193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.531747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.538127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.538579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.539344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.539784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.670509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.678833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d3985ce-981f-4453-9597-bb842d295871 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.150760 Aug 02 09:15:19.678833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 283/572] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:19.790880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.791504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.797654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.798100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.798861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.799291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.817839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:19.930897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.938545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cda98062-2649-418f-8d1c-2b6e3e54ede1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.151588 Aug 02 09:15:19.939116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 290/573] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.450182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.450717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.456810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.457297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.458076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.458488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.591551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:20.598948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7f80a711-c448-4aaa-a81e-5ababfb4460e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.153246 Aug 02 09:15:20.599796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 284/574] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.699190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.700148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.706393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.706853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.707629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.708072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.843212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:20.850660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-12eb64a1-c325-4ff0-8b43-7e9129412e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155579 Aug 02 09:15:20.851238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 291/575] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.960283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.960825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.967559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.968008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.968770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.969338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.100510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.109217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cec6f1fd-8383-432a-95f9-4e94565ce623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.152407 Aug 02 09:15:21.109780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 285/576] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:21.619880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:21.620525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:21.626517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.627034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.627791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.628219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.761273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.768740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8393c412-3fbb-406e-9b25-3c6da48ba180 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.152878 Aug 02 09:15:21.769344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 292/577] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:21 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:21.872391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:21.872909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:21.879773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.880227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.880994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.881456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.013380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.020819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8de4a63b-c78b-4836-bc91-0acfceb1a4ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.152956 Aug 02 09:15:22.021435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 286/578] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:22.130778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.131328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.137665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.138117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.138881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.139316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.266781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.274278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ec49a17f-e70b-437d-906e-e48345c09432 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.147885 Aug 02 09:15:22.274842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 293/579] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:22.789025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.789686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.795577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.796023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.796783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.797242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.936648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.944232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cdd01674-288f-4498-8a71-863e0aa87d68 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.158983 Aug 02 09:15:22.944987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 287/580] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:23.041670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.042307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.048725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.049192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.049951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.050383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.184243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:23.191739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-869c28e1-890a-44d3-8a78-73efc7e59c1a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.154068 Aug 02 09:15:23.192334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 294/581] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:23.295854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.296477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.302459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.302916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.303686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.304125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.434315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:23.441584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5b87b8df-e667-4149-8e50-a41e0a48da67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.149701 Aug 02 09:15:23.442144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 288/582] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:23 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:23.966155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.966708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.972810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.973297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.974067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.974508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.104340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:24.111815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb25e071-dd4c-493a-8de1-a723070dc4ff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.150218 Aug 02 09:15:24.112424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 295/583] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:23 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:24.213294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:24.214042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:24.220602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.220997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.221818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.222265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.353565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:24.361025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31b33e05-b7e4-44d4-a2a5-7184feafc9b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.152112 Aug 02 09:15:24.361624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 289/584] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:24.464337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:24.465064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:24.471116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.471520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.472292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.472756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.603320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:24.610955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4c81aa86-2e52-43dc-bbc2-59bf29bc3375 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.151281 Aug 02 09:15:24.611535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 296/585] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:24 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:25.132618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:25.133263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:25.139261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.139702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.140488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.140921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.272969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:25.281861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef443cfa-603e-43ed-adb7-27e3e8b30621 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.153406 Aug 02 09:15:25.282420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 290/586] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:25 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:25.381780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:25.382400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:25.389712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.390105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.390904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.391344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.519826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:25.527476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c1e7c13-8d9e-4ae5-8982-46ab378d8740 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.149865 Aug 02 09:15:25.528047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 297/587] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:25.632506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:25.633125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:25.639870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.640250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.641000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.641458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.772120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:25.779809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9864d7f8-d9be-4da4-95a3-8dca947345b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.151320 Aug 02 09:15:25.780373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 291/588] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:25 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:26.302866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:26.303521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:26.311189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.311658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.312619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.313070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.445463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:26.452821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2b8d2b2d-9550-48ef-809b-18a92b95b3e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.154269 Aug 02 09:15:26.453416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 298/589] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:26 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:26.547724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:26.548316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:26.554804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.555199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.555957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.556538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.691496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:26.699669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c05e15ef-9e3b-49b1-aa95-1e500a6d5eae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155815 Aug 02 09:15:26.700238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 292/590] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:26.802275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:26.802891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:26.808998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.809417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.810185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:26.810624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.948206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:26.955655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01953182-1f08-4db3-a92f-f64c4abad116 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.157272 Aug 02 09:15:26.956215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 299/591] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:26 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:27.474289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:27.474908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:27.482071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.482531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.483307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.483751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.615385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:27.623478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-55b5544d-1acf-4bc1-882c-70dd11032275 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.153059 Aug 02 09:15:27.624055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 293/592] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:27.721960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:27.722659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:27.730436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.730822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.731653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.732129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.867006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:27.874732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4282478b-75c8-4233-8e42-05664f4f38fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.156813 Aug 02 09:15:27.875933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 300/593] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:27.977095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:27.977734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:27.984367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.984756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.985560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.986003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.118466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:28.126019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3911c051-4d59-4998-b877-c64c894fdfd3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.152981 Aug 02 09:15:28.126598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 294/594] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:27 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:28.644707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:28.645350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:28.651589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.652036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.652820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.653296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.787539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:28.795839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ce4d4d0-1750-4087-be86-fac99703d9fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.155051 Aug 02 09:15:28.796409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 301/595] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:28 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:28.898035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:28.898625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:28.906565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.907138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.908133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.908693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.019457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:29.020234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:29.026412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.026872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.027648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.028349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.070592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:29.078600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e19b100c-8f5e-4046-91a2-c6834bcdd9e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.185029 Aug 02 09:15:29.079181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 295/596] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:29.147994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:29.148705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:29.155631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.156080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.156855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.157335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.160330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:29.171918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lazy-loading 'services' on Instance uuid 50686e38-723f-480e-9e37-f2d5e9eaaaf0 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:29.293226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6dfafd60-461f-4e52-abe2-791d34001aa1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments/cf7bd558-b0dd-4fd5-9d43-539ea4a31978" status: 202 len: 0 microversion: 2.1 time: 0.277520 Aug 02 09:15:29.293954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 302/597] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:15:29 2022] DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments/cf7bd558-b0dd-4fd5-9d43-539ea4a31978 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:15:29.301211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:29.310654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fb256898-7116-4b73-bd61-4425cb80df9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.166545 Aug 02 09:15:29.311468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 296/598] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:29 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:29.818277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:29.819029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:29.826525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.827009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.827811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.828251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.965570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:29.974855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-92c75168-0878-4469-93a3-a8dcb1ac699c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.161389 Aug 02 09:15:29.975452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 303/599] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:29 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:30.099524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:30.100138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:30.106993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:30.107442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:30.108212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:30.108664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:30.248175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:30.255826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aff3c73c-29a0-4ee1-9403-255edb9311d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.160238 Aug 02 09:15:30.256389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 297/600] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:30.334682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:30.335189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:30.341437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:30.341881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:30.342636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:30.343066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:30.476447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:30.485170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-62bce76f-0456-42d4-a9cf-e191356180b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.154459 Aug 02 09:15:30.485758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 304/601] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:30 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:30.996251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:30.996861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:31.003229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:31.003685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:31.004765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:31.005290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:31.148340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:31.157059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2735053-5da6-49d5-996f-0e43d5c4377a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.164962 Aug 02 09:15:31.157663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 298/602] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:31.278667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:31.279255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:31.285904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:31.286351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:31.287108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:31.287536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:31.428474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:31.437816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6fb63aff-e989-4db2-b0bc-8eddbb2fc256 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.163867 Aug 02 09:15:31.438520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 305/603] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:31.514055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:31.514658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:31.520941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:31.521430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:31.522194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:31.522632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:31.655526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:31.664861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc82c358-1f4d-4801-a7f2-a0a0e478dd20 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.155305 Aug 02 09:15:31.666070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 299/604] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:31 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:32.178091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:32.178711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:32.185524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.185975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.186751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.187188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.206290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:32.328865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:32.336494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60c46a85-1b83-4d7c-b70c-6f911e0c88a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.162385 Aug 02 09:15:32.337080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 306/605] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:32 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:32.468806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:32.469385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:32.475818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.476270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.477034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.477498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.616147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:32.624715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5980bb5a-a1ba-4567-83d1-fc53823ad87c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.159879 Aug 02 09:15:32.625312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 300/606] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:32.691428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:32.692084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:32.698657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.699244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.699983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.700410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.835450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:32.843390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02237a5d-3c82-4db9-a69a-58008b5da875 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.156160 Aug 02 09:15:32.843959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 307/607] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:32 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:32.896531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:32.897260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:32.906053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.906953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.908297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.908871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.944308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4b78231f-11c4-44e1-a8f0-e0768262ba26 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments/c837a4be-60d0-42f8-9b96-6e6a50e807d1" status: 200 len: 194 microversion: 2.20 time: 0.053066 Aug 02 09:15:32.944907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 301/608] 10.222.0.100 () {60 vars in 1459 bytes} [Tue Aug 2 09:15:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments/c837a4be-60d0-42f8-9b96-6e6a50e807d1 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:33.013855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.014350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.020502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.020891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.021696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.022139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.105767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lazy-loading 'services' on Instance uuid c376609c-79b9-4ca5-91a3-febc97aecc9d {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:33.180725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f47f41d7-8e13-4016-aab5-f8029eb89d87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments/c837a4be-60d0-42f8-9b96-6e6a50e807d1" status: 202 len: 0 microversion: 2.20 time: 0.171504 Aug 02 09:15:33.182171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 308/609] 10.222.0.100 () {60 vars in 1462 bytes} [Tue Aug 2 09:15:33 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments/c837a4be-60d0-42f8-9b96-6e6a50e807d1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:15:33.190740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.192994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.199930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.200383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.201173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.201623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.231413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-693909d0-8bb5-47cf-8858-fc0a0c321558 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044674 Aug 02 09:15:33.232031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 302/610] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:33.358556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.359264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.366163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.366611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.367411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.367887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.507020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:33.514945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52dbbc1a-d079-49b7-b7b6-7002c2f3e9e9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.160686 Aug 02 09:15:33.515588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 309/611] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:33.645700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.646338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.653373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.653819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.654579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.655004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.788501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:33.797012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ec17af5c-f47c-4fab-9d53-0aba2436d713 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155045 Aug 02 09:15:33.797548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 303/612] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:33.867139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.868075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.876757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.877485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.878621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.879569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.019863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:34.028298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d2d4f15e-b69d-4d92-be50-dc19d3c0cb76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.166620 Aug 02 09:15:34.028886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 310/613] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:34.244644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:34.246904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:34.252998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.253482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.254513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.254947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.286043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6dddc9db-c6e1-4524-bd5e-51634d43b2d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045637 Aug 02 09:15:34.286642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 304/614] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:34.536232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:34.536879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:34.543938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.544683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.544969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.545433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.699049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:34.706786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdfe7363-ec59-4af6-9701-b6aff0843024 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.174456 Aug 02 09:15:34.707366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 311/615] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:34 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:34.817832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:34.818447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:34.825012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.825495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.826268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:34.826784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:34.966132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:34.973643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-27f1f5d6-cbfc-41ef-b8d2-5a55ef7f3c24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.159774 Aug 02 09:15:34.974206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 305/616] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:35.049575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:35.050198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:35.056379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.056826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.057632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.058069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.206008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:35.214411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-494b5c83-0745-42c8-a605-f2e1f3aee2a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.168600 Aug 02 09:15:35.215002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 312/617] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:35 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:35.298886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:35.301028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:35.307557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.308008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.308777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.309237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.341072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-617a394c-1561-4430-ad4d-2a8f4139360b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046124 Aug 02 09:15:35.341666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 306/618] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:35.729918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:35.730676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:35.738449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.738995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.739879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:35.740404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:35.881797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:35.889590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b8e762ad-dd34-4c22-a526-e75c7b7287a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.165433 Aug 02 09:15:35.890170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 313/619] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:35 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:35.995087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:35.995627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.002173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.002627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.003392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.003829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.136774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:36.144558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ebafddb1-ed7e-4e77-83d3-ae3ff0d05f76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.153683 Aug 02 09:15:36.145148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 307/620] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:36.236862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:36.237495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.243671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.244122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.244894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.245429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.354265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:36.356791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.363666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.364251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.365161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.365694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.377500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:36.388187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fcc7e3c1-32cb-48fb-a803-3596e672338e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.155183 Aug 02 09:15:36.388779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 314/621] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:36 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:36.397857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5575e56d-3ea5-4d09-9aad-ce28e21a443d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048142 Aug 02 09:15:36.398417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 308/622] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:15:36.911730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:36.912340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:36.919356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.919810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.920613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.921437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.166961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:37.167532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:37.174490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:37.174940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.175722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:37.176163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.302375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:37.310398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9d9940c3-2ccb-41c7-9d3a-b6c46af8cb39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.402695 Aug 02 09:15:37.310991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 315/623] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:37.347829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:37.355751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e4eea5c2-8143-4c8c-bbc1-3481395ac28c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.192757 Aug 02 09:15:37.356320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 309/624] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:37.410877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:37.412743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:37.413140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:37.413392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:37.419858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:37.420235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.420397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:37.420831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.421028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:37.421478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.421636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:37.422063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:37.452969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c9fae8e7-b63c-4402-ba54-f27771226747 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046062 Aug 02 09:15:37.453638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 316/625] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:37.566572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:37.579136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2de5de09-3aa8-4eb4-91b8-fc546a2e8287 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.170154 Aug 02 09:15:37.579710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 310/626] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:37 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:38.331837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:38.332446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:38.339605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.340042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.340799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.341263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.378460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:38.379586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:38.390075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.390763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.391855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.392502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.487235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:38.495481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5d71bc09-0025-413b-8066-a4ffff94b248 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.167477 Aug 02 09:15:38.496107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 317/627] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:38 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:38.500946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:38.503128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:38.510609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.511065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.511849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.512289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.544152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b66f0b21-44b4-4bc3-8bed-4b6228aed3c6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046961 Aug 02 09:15:38.544915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 318/628] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:38.556348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:38.564045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94c71bc9-a230-4da1-934d-3a7dd6abdf8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.190594 Aug 02 09:15:38.564625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 311/629] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:38.601243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:38.601861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:38.608988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.609470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.610238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:38.610675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:38.747232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:38.755224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ecdafdc7-0622-47a1-b352-90b75ecaf867 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.157879 Aug 02 09:15:38.755803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 319/630] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:38 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:39.520692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:39.521337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:39.523657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:39.529792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.530242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.531011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.531447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.556833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:39.559176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:39.565939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.566382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.567150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.567641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.599499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1753ad8a-5907-4b0b-89af-e2209e64997f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047312 Aug 02 09:15:39.600096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 320/631] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:15:39.606287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:39.606287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:39.612424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.612857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.613733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.614164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.771967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:39.781847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cf814030-97d0-44e3-b139-dbe860724951 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.180687 Aug 02 09:15:39.782441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 321/632] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:39.796188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:39.796999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:39.804895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.805561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.806550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:39.807245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:39.832003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:39.927629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:39.929823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:39.936719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4bff1117-9537-4576-84f2-948589b88937 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.419879 Aug 02 09:15:39.937558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 312/633] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:39.974652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:39.983602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6c55dfd9-8537-4258-8339-b0c7a3fbc4b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.193215 Aug 02 09:15:39.984186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 322/634] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:39 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:40.613586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:40.615773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:40.622682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.623135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.623916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.624356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.656287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-54fa6bff-d64c-4404-bf82-54308a36844b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046822 Aug 02 09:15:40.656847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 313/635] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:40.803544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:40.804208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:40.806924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=92 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:40.812282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.812735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.813568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.813999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.953593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:40.958420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:40.959209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:40.962771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3317517a-79ec-4b92-8be1-c9c51a07f0c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.162585 Aug 02 09:15:40.963364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 323/636] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:40.966103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.966594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:40.967423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:40.967808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.014306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:41.015039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:41.021287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.021817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.022825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.023336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.130547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:41.139260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3fd33b16-81f9-4374-ac32-91c216ac2075 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.184920 Aug 02 09:15:41.139800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 314/637] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:40 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:41.171757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:41.183052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e14818e-d9ec-45d2-b61e-efae89848654 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.172584 Aug 02 09:15:41.183656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 324/638] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:41 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:41.669252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:41.671621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:41.678188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.678634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.679395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.679873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.710249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-551b5004-a5ba-49a1-8386-71955aac135a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045746 Aug 02 09:15:41.710809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 315/639] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:41.983569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:41.984211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:41.990786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.991235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.992001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.992435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.139208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:42.148474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-82cbd4ba-5a81-43d2-9a5a-2234848edb38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.168752 Aug 02 09:15:42.149186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 325/640] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:42.163033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:42.163862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:42.171612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.172126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.173103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.173571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.205414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:42.206030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:42.212288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.212731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.213539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.213968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.312682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:42.321755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-65f27272-4927-43c9-9f8c-8bc63459600f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.163183 Aug 02 09:15:42.322406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 316/641] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:42.351776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:42.360230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b576401c-6314-4ba9-84d0-d6f653310fb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.158746 Aug 02 09:15:42.360819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 326/642] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:42 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:42.723404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:42.725545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:42.732748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.733231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.734035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.734470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.764493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-90b9f1a4-4264-4d78-9d65-11920332bd20 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045000 Aug 02 09:15:42.765071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 317/643] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:43.171595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:43.172238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:43.178825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.179277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.180044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.180517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.320367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:43.328268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd2b09f1-1ddf-49c5-a1ff-f0015715c0bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.160499 Aug 02 09:15:43.328844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 327/644] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:43.344015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:43.344740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:43.353253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.353886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.354929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.355547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.383187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:43.384022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:43.390246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.390696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.391471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.391896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.504651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:43.512943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e69d06d4-43a7-47c2-a1e8-63fc8dac612f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.174082 Aug 02 09:15:43.513556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 318/645] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:43 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:43.542547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:43.550492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-af38e538-b974-4957-a2ab-0b4c6ff83b19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.171346 Aug 02 09:15:43.551101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 328/646] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:43 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:43.778447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:43.780630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:43.787112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.787555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.788321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.788758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.818346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ce98560-ffee-4ba9-9ec7-e1d4ed9407d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044952 Aug 02 09:15:43.818904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 319/647] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:44.349220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:44.349843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:44.356569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.357024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.357835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.358276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.497428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:44.505638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85e132af-f23e-4ac7-86ff-6f4d0f39857d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.160357 Aug 02 09:15:44.506209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 329/648] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:44.534062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:44.534679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:44.541690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.542133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.542913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.543347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.578660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:44.579399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:44.587326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.588086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.589571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.590388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.689921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:44.698586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07072639-5fa7-4d61-b9cc-793729249486 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.168353 Aug 02 09:15:44.699176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 320/649] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:44.740207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:44.747803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39c9c90c-1713-4f25-837a-c997b38e5c75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.173923 Aug 02 09:15:44.748384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 330/650] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:44 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:44.831958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:44.834134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:44.841577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.842032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.842805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.843246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.873525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3115b9c2-85e6-4df9-8e98-2c263ca87783 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045538 Aug 02 09:15:44.874107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 321/651] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:45.526918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:45.527527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:45.534153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.534632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.535395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.535833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.670587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:45.678676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-00891c60-08f9-474f-af4a-41d50275bbd5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155733 Aug 02 09:15:45.679253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 331/652] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:45.721312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:45.721917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:45.728535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.728979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.729765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.730194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.772983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:45.773865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:45.781239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.781752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.782530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.782969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.871088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:45.878615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff789ce1-4e9c-4058-94ca-578629bacb2f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.161235 Aug 02 09:15:45.879442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 322/653] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:45 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:45.885982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:45.888231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:45.894628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.895075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.895845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.896277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.924016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:45.927905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e584d2b-472a-461a-a16f-54f2b29b3d64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045965 Aug 02 09:15:45.928640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 323/654] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:45.932025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff61be24-94a4-47fc-9170-a3b8b4af822d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.164143 Aug 02 09:15:45.932606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 332/655] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:45 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:46.699347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:46.699904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:46.706000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.706452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.707222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.707658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.849379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:46.857600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-498417b4-13ba-4d31-bbe9-e5d5ae8ca42b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.162169 Aug 02 09:15:46.858160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 324/656] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:46.900823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:46.901585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:46.908132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.908574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.909372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.909805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.940090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:46.942665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:46.949823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.950205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.950988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.951429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.982697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e3830dd6-9f30-4fae-b613-0ac29b2dd572 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046549 Aug 02 09:15:46.983276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 325/657] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:15:46.991847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:46.992463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:46.998577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.999029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.999803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:47.000244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:47.055854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:47.065727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7dab4317-869b-44f7-a9be-31ff7f5cbc57 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.169264 Aug 02 09:15:47.066397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 333/658] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:47.139271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:47.147941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-859690e5-b11f-433a-9286-0d9fbfb494a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.159634 Aug 02 09:15:47.148632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 326/659] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:46 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:47.880716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:47.881762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:47.889256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:47.889645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:47.890478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:47.890843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:47.995391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:47.997811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:48.005255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.005707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.006486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.006964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.040332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f1aee13d-8b2d-4217-b0a1-47d70f3c906d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048377 Aug 02 09:15:48.041515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 327/660] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:48.065360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:48.073585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-37add724-8ebb-43e1-9b7c-53ab0fe42ef6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.198616 Aug 02 09:15:48.074252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 334/661] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:48.088434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:48.089053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:48.095366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.095810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.096614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.097041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.170524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:48.171155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:48.178188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.178647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.179444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.179898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.269214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:48.277290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95022ad5-dbab-4974-b091-49ce2b130e8d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.193391 Aug 02 09:15:48.277875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 328/662] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:48.324978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:48.335251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-679ba3c6-e591-4f2d-a5a0-b4188c40263b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.168865 Aug 02 09:15:48.335841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 335/663] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:48 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:49.054174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:49.056805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:49.063242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.063684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.064443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.064872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.078593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:49.094846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:49.096299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:49.096632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b0697fdb-0f01-4eea-98ac-02ccbf692b5d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046653 Aug 02 09:15:49.097618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 329/664] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:49.104527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.105216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.106606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.107141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.261140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:49.268742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-44ebba02-3611-4fbd-9fd3-922bd27d23ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.177668 Aug 02 09:15:49.269345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 336/665] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:49 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:49.311585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:49.312104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:49.318171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.318619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.319417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.319853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.357528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:49.358143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:49.364240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.364694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.365509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.365948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.454272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:49.466138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0eb7057f-9c0b-4c91-8fde-27e6d1352a59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.158407 Aug 02 09:15:49.466983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 330/666] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:49.507599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:49.515372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-411fa261-306b-4600-96f8-f35019eedc16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.161660 Aug 02 09:15:49.515954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 337/667] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:49 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:50.110469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:50.113065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:50.119684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.120138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.120913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.121387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.153003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-11aa39ab-116d-408e-b575-b05dba687182 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047517 Aug 02 09:15:50.153623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 331/668] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:50.289820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:50.290694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:50.298203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.298665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.299409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.299839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.433315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:50.440912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2cdbec37-54e8-40f0-b1dc-1f31ce90f486 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.155166 Aug 02 09:15:50.441533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 338/669] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:50.491871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:50.492428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:50.499166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.499626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.500431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.500872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.538800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:50.539949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:50.546221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.546666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.547457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.547894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.552233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:50.645438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:50.653069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e200a74a-0be2-4359-ba4b-792e4380fdf4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.165153 Aug 02 09:15:50.653678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 332/670] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:50 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:50.698306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:50.705802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0bb14ce-fa66-412f-802f-61c94e0a4f5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.171206 Aug 02 09:15:50.706380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 339/671] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:50 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:51.166791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:51.168961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:51.175899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.176277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.177096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.177561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.208630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6f71a0f9-df15-4c82-a5b0-a70c58f21647 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047011 Aug 02 09:15:51.209211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 333/672] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:51.463078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:51.463633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:51.470577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.471087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.471946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.472645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.641823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:51.654075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0df3bb9-9cad-42eb-8e8f-c231f8df04be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.195681 Aug 02 09:15:51.654680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 340/673] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:51.675416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:51.676303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:51.685375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.686016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.687508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.688113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.730563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:51.731368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:51.737814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.738326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.739229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.739727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.848718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:51.859772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a99ed576-ff31-4dd8-a06e-7711ca166c94 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.189148 Aug 02 09:15:51.861101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 334/674] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:51.903871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:51.912006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0399a14c-fb5d-4b0d-8538-27c17a2d1224 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.187788 Aug 02 09:15:51.912581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 341/675] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:51 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:52.222811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:52.225404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:52.233427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.233931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.234750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.235241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.267008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1ad204ef-f055-42e7-bdf3-adfea492d960 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048615 Aug 02 09:15:52.267548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 335/676] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:52.473295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:52.475716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:52.483349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.483902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.484747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.485298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.511538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lazy-loading 'flavor' on Instance uuid 653f50f6-3df3-4a7a-baef-b1222520a28f {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:52.676820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:52.678136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:52.687199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c0f682e9-1827-4d44-aebd-c210bdfdf334 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/action" status: 200 len: 32 microversion: 2.1 time: 0.218015 Aug 02 09:15:52.693628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 342/677] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:15:52 2022] POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:15:52.694104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.700429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:52.701276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:52.707920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.708381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.709797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.710623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.714374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.715495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.718876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.862875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:52.873013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39e2b329-7948-433d-b623-39f838462b5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.177639 Aug 02 09:15:52.873665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 343/678] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:52.891451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:52.892323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:52.898660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.899746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:52.900532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:52.900977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.027912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:53.042961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-76bfc2d9-3508-4bbe-ab1b-e0224d5eef42 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.370637 Aug 02 09:15:53.053386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 336/679] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:53.059838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:53.065678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:53.068087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:53.073363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.074395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.075363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.075962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.076223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0ccae2a-4d51-4ef5-8e2a-7e39b7c69e20 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.198763 Aug 02 09:15:53.076817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 344/680] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:53.280710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:53.283347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:53.291268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.291717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.292540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.292981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.326257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8d58a402-181b-4767-a2c4-861e30f81801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049575 Aug 02 09:15:53.327116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 345/681] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:15:53.360568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:53.368896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c8479e7-217e-4979-9c43-60815d79fead tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1686 microversion: 2.1 time: 0.314137 Aug 02 09:15:53.369557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 337/682] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:53 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1686 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:53.896278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:53.897055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:53.903758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-963f581e-cec4-4834-a502-518de8dac6d7 req-42b767ac-3059-4b12-8332-6991e5c7d1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64272d61-0647-41fa-960d-d71df9c72c70", "name": "network-vif-plugged", "status": "completed", "tag": "86db858b-f033-44df-ba65-35bb43a0e045"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:53.909993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.911559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.916813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.917356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.939914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-963f581e-cec4-4834-a502-518de8dac6d7 req-42b767ac-3059-4b12-8332-6991e5c7d1d5 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:53.940602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-963f581e-cec4-4834-a502-518de8dac6d7 req-42b767ac-3059-4b12-8332-6991e5c7d1d5 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:53.965817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-963f581e-cec4-4834-a502-518de8dac6d7 req-42b767ac-3059-4b12-8332-6991e5c7d1d5 service nova] Creating event network-vif-plugged:86db858b-f033-44df-ba65-35bb43a0e045 for instance 64272d61-0647-41fa-960d-d71df9c72c70 on hv-cinder-80382 Aug 02 09:15:53.975448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-963f581e-cec4-4834-a502-518de8dac6d7 req-42b767ac-3059-4b12-8332-6991e5c7d1d5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075002 Aug 02 09:15:53.976702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 338/683] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:15:54.071164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:54.073004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:54.085503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.086355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.088156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.088806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.112278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:54.123437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40dce702-8a30-4a17-9e22-e21acb8fc122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.231099 Aug 02 09:15:54.142121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 346/684] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:54.148131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-91e9a881-29dd-4b29-928f-e303262f73b4 req-9e005a2f-0aca-4770-96e4-93dbadc1c8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddaf95ef-cb6f-4ed0-a20d-a4df82191123", "name": "network-vif-deleted", "tag": "3c66bd43-60f2-46b5-ab91-79f33bed866d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:54.164516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-91e9a881-29dd-4b29-928f-e303262f73b4 req-9e005a2f-0aca-4770-96e4-93dbadc1c8fd service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.165428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-91e9a881-29dd-4b29-928f-e303262f73b4 req-9e005a2f-0aca-4770-96e4-93dbadc1c8fd service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.183971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-91e9a881-29dd-4b29-928f-e303262f73b4 req-9e005a2f-0aca-4770-96e4-93dbadc1c8fd service nova] Creating event network-vif-deleted:3c66bd43-60f2-46b5-ab91-79f33bed866d for instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 on hv-cinder-80382 Aug 02 09:15:54.199309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-91e9a881-29dd-4b29-928f-e303262f73b4 req-9e005a2f-0aca-4770-96e4-93dbadc1c8fd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054361 Aug 02 09:15:54.201069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 347/685] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:54.218762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:54.219930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:54.249767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.250766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.255615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.256793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.530307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:54.539658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-06f40f95-3dc9-45c8-9c6a-ee0033a99162 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.475195 Aug 02 09:15:54.540713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 339/686] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:54.544897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:54.546676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:54.549299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:54.555221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6afc46dd-6667-49db-a8b8-f6a7e9bc90a1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.352235 Aug 02 09:15:54.556013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 348/687] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:54.556953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.557608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.558601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.559274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.561502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:54.562213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:54.569623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.570162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.571843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.573334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.600825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a40ad7e-4b58-4309-a22e-5900e56730e1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058584 Aug 02 09:15:54.601731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 340/688] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:54.610958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.611840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.612374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lazy-loading 'fault' on Instance uuid ddaf95ef-cb6f-4ed0-a20d-a4df82191123 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:54.659407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:54.667260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5d2812ae-1ade-469a-94a5-cd1fb8d9bfb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 200 len: 1335 microversion: 2.1 time: 0.110080 Aug 02 09:15:54.667998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 349/689] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:54 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:55.166501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.167021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.173036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.173528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.174314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.174758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.310409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:55.326888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7f023539-97c6-4083-a9bd-b2208e88e3e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.164483 Aug 02 09:15:55.327484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 341/690] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:55.566273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.566888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.576046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.576636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.578432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.578802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.579605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.580048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.594764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.595213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.595998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.596432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.770958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:55.780915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:55.786364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7b66dcc5-4904-40e6-a0ff-bc6c95b79a6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.213994 Aug 02 09:15:55.790076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-15b25170-075a-4982-a0bc-0796cdadbd65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1263 microversion: 2.1 time: 0.227336 Aug 02 09:15:55.790949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 350/691] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1263 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:55.796003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.799007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 342/692] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:55.800932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.809093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.809538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.809843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.810228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.811201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.811857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.815967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.816496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.817300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.817738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.832836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 HTTP/1.1 Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:15:55.834733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:15:55.836715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'ddaf95ef-cb6f-4ed0-a20d-a4df82191123'} Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:15:55.837874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:15:55.839858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:15:55.841414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:15:55.841414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c11f6b2-8458-4948-a361-76fbb2dcc2d3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 404 len: 111 microversion: 2.1 time: 0.036042 Aug 02 09:15:55.841414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 343/693] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:15:55.846967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-19e3148c-8b03-48d5-96bb-e57a564c752b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '.version_select at 0x7f8c18073d30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.852611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-53649b09-920a-4ff2-bb41-70017285bb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059703 Aug 02 09:15:55.853689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19e3148c-8b03-48d5-96bb-e57a564c752b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [cbda9b87-0252-4245-866f-db9d67ef0fb0] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 09:15:55.855190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 351/694] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:56.055690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-99d99e78-f28e-4d2c-bc77-56e7bc5017fe req-cc868b3f-babc-42e6-b335-1a45a1cb4033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740332a9-5b49-41cf-9db1-ec96264ed7fd", "name": "network-vif-plugged", "status": "completed", "tag": "87c73e63-4764-4978-b58d-e5e8146a5f51"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:56.065335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-99d99e78-f28e-4d2c-bc77-56e7bc5017fe req-cc868b3f-babc-42e6-b335-1a45a1cb4033 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.065786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-99d99e78-f28e-4d2c-bc77-56e7bc5017fe req-cc868b3f-babc-42e6-b335-1a45a1cb4033 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.077088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-99d99e78-f28e-4d2c-bc77-56e7bc5017fe req-cc868b3f-babc-42e6-b335-1a45a1cb4033 service nova] Creating event network-vif-plugged:87c73e63-4764-4978-b58d-e5e8146a5f51 for instance 740332a9-5b49-41cf-9db1-ec96264ed7fd on hv-cinder-80382 Aug 02 09:15:56.082291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-99d99e78-f28e-4d2c-bc77-56e7bc5017fe req-cc868b3f-babc-42e6-b335-1a45a1cb4033 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030997 Aug 02 09:15:56.083054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 352/695] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:15:56.351580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:56.352987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:56.359502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.359961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.360891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.361386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.505032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:56.513912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7170c6b3-0ca6-4467-857c-8c62f9297853 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.167485 Aug 02 09:15:56.514487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 353/696] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:56.811173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:56.811843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:56.818191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.818641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.819420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.819858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.861964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [None req-19e3148c-8b03-48d5-96bb-e57a564c752b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [cbda9b87-0252-4245-866f-db9d67ef0fb0] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 44936. Aug 02 09:15:56.887465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-19e3148c-8b03-48d5-96bb-e57a564c752b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418026798" status: 202 len: 0 microversion: 2.1 time: 1.044348 Aug 02 09:15:56.888276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 344/697] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418026798 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:56.894263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:56.895106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:56.905189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.905189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.906035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.906452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.972948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:56.976902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:56.983381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-baccf2b9-ada5-431b-abe4-1436134111c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1269 microversion: 2.1 time: 0.176175 Aug 02 09:15:56.989172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 354/698] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:56.991653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:56.994634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:57.003865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.004609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.005384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.005821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.037199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-010dc7a2-39fb-4709-b1b6-0b40d2c55e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051798 Aug 02 09:15:57.037784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 355/699] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:57.118035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:57.128541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66e69d67-d414-40ad-8f13-0fbcbdef4f88 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1447 microversion: 2.1 time: 0.239018 Aug 02 09:15:57.129782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 345/700] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1447 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:57.156959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:57.158129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:57.172928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.173623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.174455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.174897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.429310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:57.437104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21a38aa7-bed8-497a-9561-640d8e403495 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1447 microversion: 2.1 time: 0.286303 Aug 02 09:15:57.437901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 356/701] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1447 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:57.536118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:57.536928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:57.543677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.544126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.544902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.545377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.827729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:57.828270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:57.836869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.837365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.838151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:57.838587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.935772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lazy-loading 'services' on Instance uuid 02e2d9a6-78b8-4f7a-8216-490f423ba511 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:58.023269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e62371b-4b47-4643-a6a7-fb284b408c43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments/ef39c29f-d8cc-4b8d-9e22-89a2668d8edb" status: 202 len: 0 microversion: 2.1 time: 0.199213 Aug 02 09:15:58.024483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 357/702] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:15:57 2022] DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments/ef39c29f-d8cc-4b8d-9e22-89a2668d8edb => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:15:58.029691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:58.030396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:58.036760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.037231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.038004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.038438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.058442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:58.069584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-645619af-a388-4012-b665-2bddaaa79239 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.537395 Aug 02 09:15:58.071006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 346/703] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:58.076091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:58.078380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:58.084437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.084887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.085689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.086859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.118954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1fbddcc6-b5af-47b1-a8a5-62d1644143d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046680 Aug 02 09:15:58.119512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 347/704] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:15:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:58.124613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:58.127206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:58.134910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.135285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.136222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.136668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.152217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:58.170025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87a0bafd-5d0c-42de-aaff-3539f477bf76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049450 Aug 02 09:15:58.171099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 348/705] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:58.212153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:58.220450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0e23677-cb2f-491a-ae69-f998e14919c5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1457 microversion: 2.1 time: 0.194762 Aug 02 09:15:58.223618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 358/706] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1457 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:58.241103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:58.241828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:58.248046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.248529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.249338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.249780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.481569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:58.489819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-416c2526-7311-4a56-8d51-eed8dddc40c7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1457 microversion: 2.1 time: 0.252453 Aug 02 09:15:58.490404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 349/707] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1457 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:59.092906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:59.093660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:59.101271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.101972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.103156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.103705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.132385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:59.135973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:59.144963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.145450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.146241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.146985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.189606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c206c50e-caf3-466e-a2cf-01b3f52d0fb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060976 Aug 02 09:15:59.190504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 350/708] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:15:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:59.200837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:59.203980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:59.210710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.211278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.212555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.212555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.247509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2bd92e35-e0f7-4701-b509-81446a2b1765 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055372 Aug 02 09:15:59.248352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 351/709] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:15:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:59.270503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:59.279092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d32c086-c685-4794-888d-070f507b10c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.190791 Aug 02 09:15:59.280432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 359/710] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:15:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:00.204255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.206753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.215344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.215910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.217262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.217822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.251979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bd499263-98ef-46ce-806f-639e83d66c5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051689 Aug 02 09:16:00.252570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 352/711] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:00.262272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.264640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.272463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.273086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.274726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.275246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.301804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.302436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.308930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.311084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.312312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.312729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.313700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd919dac-5ad3-4fb5-8922-a654503198f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054367 Aug 02 09:16:00.314339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 360/712] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:00.654576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:00.665054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-820b8ded-8429-47a4-b508-0fd0a773b942 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.367305 Aug 02 09:16:00.665837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 353/713] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:00.680488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-08fda5af-5192-4555-bffd-19afa29f7edb req-9ab9dc9d-ae43-40f1-94f2-2e814022b367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64272d61-0647-41fa-960d-d71df9c72c70", "tag": "86db858b-f033-44df-ba65-35bb43a0e045"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:00.690037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-08fda5af-5192-4555-bffd-19afa29f7edb req-9ab9dc9d-ae43-40f1-94f2-2e814022b367 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.690712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-08fda5af-5192-4555-bffd-19afa29f7edb req-9ab9dc9d-ae43-40f1-94f2-2e814022b367 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.702408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-08fda5af-5192-4555-bffd-19afa29f7edb req-9ab9dc9d-ae43-40f1-94f2-2e814022b367 service nova] Creating event network-changed:86db858b-f033-44df-ba65-35bb43a0e045 for instance 64272d61-0647-41fa-960d-d71df9c72c70 on hv-cinder-80382 Aug 02 09:16:00.707382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-08fda5af-5192-4555-bffd-19afa29f7edb req-9ab9dc9d-ae43-40f1-94f2-2e814022b367 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 Aug 02 09:16:00.708009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 361/714] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:01.265327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:01.268193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:01.275556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.276716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.277835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.278552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.318151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9bcfc8e1-3595-4363-82de-0375c323f69b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056929 Aug 02 09:16:01.319049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 354/715] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:01.329975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:01.333014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:01.339813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.340262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.341265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.341705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.377581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b44f4524-99c1-4ece-9b94-7848d7354cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052637 Aug 02 09:16:01.378167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 362/716] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:01.688035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:01.688869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:01.697218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.698032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.699040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:01.699723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.107376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:02.115364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94452397-f23f-4291-80c9-b80fd91e8381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.431258 Aug 02 09:16:02.115932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 355/717] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:02.331386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:02.333717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:02.340502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.340951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.341758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.342381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.374457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-faa68f8f-65eb-4d8d-bd5e-4e59d7a85e33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Aug 02 09:16:02.375062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 363/718] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:02.393763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:02.397580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:02.405957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.406502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.407352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.407886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.441559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-46ebbc6a-a53b-48eb-bb0b-804e6461f567 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053288 Aug 02 09:16:02.446410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 356/719] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:02.723732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-a5b90099-905d-4571-9eea-252c5d62329e req-d8def631-89cd-4e07-aa48-a5238d525443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740332a9-5b49-41cf-9db1-ec96264ed7fd", "tag": "87c73e63-4764-4978-b58d-e5e8146a5f51"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:02.741200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a5b90099-905d-4571-9eea-252c5d62329e req-d8def631-89cd-4e07-aa48-a5238d525443 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.741999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-a5b90099-905d-4571-9eea-252c5d62329e req-d8def631-89cd-4e07-aa48-a5238d525443 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.755476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-a5b90099-905d-4571-9eea-252c5d62329e req-d8def631-89cd-4e07-aa48-a5238d525443 service nova] Creating event network-changed:87c73e63-4764-4978-b58d-e5e8146a5f51 for instance 740332a9-5b49-41cf-9db1-ec96264ed7fd on hv-cinder-80382 Aug 02 09:16:02.760909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-a5b90099-905d-4571-9eea-252c5d62329e req-d8def631-89cd-4e07-aa48-a5238d525443 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040802 Aug 02 09:16:02.761713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 364/720] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:03.141313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:03.142033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:03.151902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.152684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.154157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.155078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.368854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:03.377086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-97d43a52-50b6-48d2-82b9-8e5431f93b85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.242526 Aug 02 09:16:03.377700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 357/721] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:03.388583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:03.390993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:03.397892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.398945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.399960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.400410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.430299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11e999a0-d0b4-4ea3-bd70-354c404e0e53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Aug 02 09:16:03.430938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 365/722] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:03.454929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:03.457144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:03.463516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.463973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.464756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.465230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.497214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7cfbf913-5a4d-4ea0-944f-c0c6bf40c203 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046386 Aug 02 09:16:03.497823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 358/723] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:04.400869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:04.401642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:04.408296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.408745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.409546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.410009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.442945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:04.446002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:04.452729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.453323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.454112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.454554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.484610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c9dcfef-1d12-40b4-a1a4-1276c42f7db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Aug 02 09:16:04.486037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 359/724] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:04.510640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:04.512797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:04.518927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.519383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.520166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.520606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.548076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:04.552914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-48e5f915-d65d-4de2-8219-fea4e3b423e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046853 Aug 02 09:16:04.553656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 360/725] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:04.561408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4f003e6-9cc2-4063-98a5-8ba63c7e60c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.165563 Aug 02 09:16:04.561995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 366/726] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:05.498386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:05.500513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:05.502885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:05.510293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.510746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.511521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.511958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.543297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a8efccb-d5f5-4d58-899c-20ecf30928a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048904 Aug 02 09:16:05.543868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 361/727] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:05.566596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:05.568820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:05.576063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.576520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.577364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.577807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.583539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:05.584147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:05.590905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.591326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.592120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.592558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.608882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-24828600-ff56-487c-8ef1-79355b343729 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046317 Aug 02 09:16:05.609528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 367/728] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:05.745056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:05.753054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62e15d15-c6a2-4548-b5cd-a4c53d59b312 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.173514 Aug 02 09:16:05.753738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 362/729] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:06.556584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:06.560001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:06.566249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.566692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.567461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.567894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.598590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-99aa440a-eca0-408c-895f-57ebc4e90605 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Aug 02 09:16:06.599159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 368/730] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:06.622964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:06.625245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:06.632130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.632814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.633995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.634567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.668528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ab3dd2c6-ad04-4f2c-9b0b-d96d66a5d09e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049528 Aug 02 09:16:06.669090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 363/731] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:06.780728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:06.781551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:06.788049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.788501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.790187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:06.790403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.925852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:06.934328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8364e0f-f936-4331-b545-8fac17d47027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158619 Aug 02 09:16:06.934913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 369/732] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:07.612093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.614291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.621160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.621615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.622382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.622820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.653357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1a9116dc-2065-4a6a-9da2-95ef766d73b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Aug 02 09:16:07.654214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 364/733] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:07.681161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.683290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.689801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.690276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.691022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.691451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.721428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-084efb9c-6aa1-42b5-bfac-336578afe98d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044863 Aug 02 09:16:07.721995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 370/734] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:07.958157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.958157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.964058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.964514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.965334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.965773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.969793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:08.100654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:08.109089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-54fb1abe-322d-4f41-8794-d4a4d2ad3d85 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156902 Aug 02 09:16:08.109686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 365/735] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:08.667768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.670048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.676288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.676677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.677477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.677919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.707652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0f58476-4f68-43dd-9aa2-45cf1069f86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Aug 02 09:16:08.708276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 371/736] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:08.734029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.736211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.743208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.743648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.744717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.745177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.774061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-930a898a-c254-406b-b9b5-ce161643a45d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043974 Aug 02 09:16:08.774637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 366/737] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:09.131006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:09.131612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:09.133637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:09.138888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.139327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.140085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.140517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.144668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:09.279555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:09.288078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-695cf451-01c2-44bc-9299-833526bdf248 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161164 Aug 02 09:16:09.289189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 372/738] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:09.719558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:09.721689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:09.727980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.728434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.729242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.729719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.760985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9df59933-d1b2-415f-a6a4-0e4d00d45d59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Aug 02 09:16:09.761888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 367/739] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:09.788109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:09.790569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:09.797206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.797656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.798428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.798861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.829497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-05f57399-af9c-4fe5-9231-0546f517d560 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045428 Aug 02 09:16:09.830074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 373/740] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:10.315636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:10.316289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:10.324034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.324718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.325721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.326255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.497997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:10.507145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3faaa433-9db9-4abe-a39b-1edc240427f4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.195352 Aug 02 09:16:10.508462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 368/741] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:10.774430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:10.776593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:10.783039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.783497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.784286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.784727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.814527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e2185c7b-3f06-4dcd-bb57-8d5eda3ee7f3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Aug 02 09:16:10.815286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 374/742] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:10.842140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:10.844302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:10.850793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.851621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.852511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.853041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.893510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d207c20-4fa8-44f1-a579-e5f77af122ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055280 Aug 02 09:16:10.894280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 369/743] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:11.529628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:11.530239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:11.536297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.536735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.537528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.537952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.670666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:11.678907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72cfff1d-3268-4cd4-a308-13de055fd447 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153283 Aug 02 09:16:11.680781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 375/744] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:11.794392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:16:11.794586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:16:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:16:11.827218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:11.829375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:11.835333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.835991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.836758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.837286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.869250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fda20675-d260-430b-87a3-4d41d562a916 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Aug 02 09:16:11.869997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 370/745] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:12.016238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.018606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.026625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.027064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.027837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.028271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.079213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da9fea31-8d4f-4fca-ae1e-50c2842b4774 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175631 Aug 02 09:16:12.080160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 376/746] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:12.703766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.704377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.711127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.711649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.712493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.712918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.845842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:12.855351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-200b7344-4a9e-48f6-a03a-020c192e304e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155453 Aug 02 09:16:12.855927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 371/747] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:12.882958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.885161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.891216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.891664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.892432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.892871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.923805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-266e8509-345a-49c7-9fe6-80f2bc721fd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Aug 02 09:16:12.924392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 377/748] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:13.096051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:13.098190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.104808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.105299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.106073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.106514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.138831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b2731c94-aa1d-412d-8fb1-82fc7b2aae25 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046847 Aug 02 09:16:13.139668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 372/749] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:13.876757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:13.877406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.885207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.885653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.886428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.886855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.938297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:13.940498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.947904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.948358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.949200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.949640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.982413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d86991b-6e39-4b67-8605-fcb6fbb3f4a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048090 Aug 02 09:16:13.983009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 373/750] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:14.045553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:14.053664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-857fb783-ebfb-4875-98f1-13d83a13f927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.180714 Aug 02 09:16:14.054274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 378/751] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:14.155756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:14.158476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:14.165500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.165950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.166737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.167204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.207059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aaf2e866-d4b7-4a30-bf17-6b5652eda199 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055628 Aug 02 09:16:14.208558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 374/752] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:14.994574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:14.996824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.003474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.004173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.004934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.005389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.036487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c2e59915-e3a3-4692-9517-069eb36b36a1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046069 Aug 02 09:16:15.037060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 379/753] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:15.178123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.178820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.185757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.186212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.186993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.187438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.220344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.222730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.230196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.230636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.231448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.231878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.263764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2cf15b93-dfd4-433d-9384-52da3e4c751a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047460 Aug 02 09:16:15.264341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 380/754] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:15.330634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.338916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31f2b662-acec-41b5-878d-fcedcef5a800 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1718 microversion: 2.1 time: 0.266987 Aug 02 09:16:15.339502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 375/755] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1718 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:15.401069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.401595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.407698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.408150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.408914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.409385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.496883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] HTTP exception thrown: Cannot 'detach_volume' instance 653f50f6-3df3-4a7a-baef-b1222520a28f while it is in vm_state rescued Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Request method failure captured: Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments/f59cf3bd-aa15-4cf1-8779-3026a2361965 HTTP/1.1 Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OoxdLjv3CsKs-lcNPV6JkskJP3ZAhnpNxfIhXLfcSRed6FEQoeIGTw_CTD4Wl-T03HTedRO6XpyZOASSq1OEbtEFjk4pxMbRMgyAH6FUbIPfOrocInkzRB2X91ZY5INBbVPBem3mJnllakvGRnZHUODkaWSXh__vyRW56nNV0hE86g Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:16:15.498567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 6c30f2ab48e74d4690aafe46c4bf682f Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:16:15.500064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Cannot 'detach_volume' instance 653f50f6-3df3-4a7a-baef-b1222520a28f while it is in vm_state rescued Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '653f50f6-3df3-4a7a-baef-b1222520a28f', 'id': 'f59cf3bd-aa15-4cf1-8779-3026a2361965'} Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 653f50f6-3df3-4a7a-baef-b1222520a28f in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:15.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 653f50f6-3df3-4a7a-baef-b1222520a28f while it is in vm_state rescued Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 653f50f6-3df3-4a7a-baef-b1222520a28f while it is in vm_state rescued Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:16:15.503332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Returning 409 to user: Cannot 'detach_volume' instance 653f50f6-3df3-4a7a-baef-b1222520a28f while it is in vm_state rescued {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:15.505729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4e6f8514-de2e-45c2-8392-f5c0cf499967 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments/f59cf3bd-aa15-4cf1-8779-3026a2361965" status: 409 len: 152 microversion: 2.1 time: 0.103597 Aug 02 09:16:15.505729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 381/756] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:16:15 2022] DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments/f59cf3bd-aa15-4cf1-8779-3026a2361965 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:16:15.511195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:15.511822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.518137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.518588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.519379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.519815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.586699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8881783b-8625-4c8e-b86e-d2ab3aa4fca5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/action" status: 202 len: 0 microversion: 2.1 time: 0.080491 Aug 02 09:16:15.587325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 376/757] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:16:15 2022] POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:16:15.596749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.597776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.605637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.606220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.607855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.608251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.747622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.757559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f1b0ece3-afce-479f-bd85-94b8397de77a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1726 microversion: 2.1 time: 0.164830 Aug 02 09:16:15.758453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 382/758] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:16.106442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.108914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.115284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.115734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.116862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.117823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.152337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-da7bf21b-3f4e-412f-8263-35fa105dc6b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105685 Aug 02 09:16:16.152923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 377/759] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:16.277252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.279395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.285991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.286643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.287236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.287673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.319215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a220180e-1da5-48db-9dad-c75f6d05b808 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046855 Aug 02 09:16:16.320202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 383/760] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:16.780095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.780638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.787099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.787796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.789042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.789708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.926607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:16.934792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-729fcf07-6765-4a0c-ba36-66516479e7d2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1726 microversion: 2.1 time: 0.158643 Aug 02 09:16:16.935361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 378/761] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:17.165227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.167355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.173472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.173922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.174702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.175141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.205386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0809810f-46a0-4305-9ca3-1c7b0aa64e24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Aug 02 09:16:17.205969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 384/762] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:17.332168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.334401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.340867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.341352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.342126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.342563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.371881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b1960336-1fff-4f3c-87a5-8ff40b9ddd8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043676 Aug 02 09:16:17.372445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 379/763] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:17.957448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.958129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.966127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.966575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.967374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.967813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.105145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:18.113288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-027fbf43-fd4c-497a-bf8d-29fdb2363535 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1726 microversion: 2.1 time: 0.159819 Aug 02 09:16:18.113870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 385/764] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:18.218113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:18.220315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:18.227159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.227606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.228380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.228819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.253481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:18.259179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a90c4ce1-54d3-49cc-ab0f-a0dd0018c1f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Aug 02 09:16:18.259740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 380/765] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:18.385508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:18.387603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:18.393776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.394227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.395002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.395440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.425889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-060fe566-a0ca-491e-b385-08f07416e279 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045243 Aug 02 09:16:18.426454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 386/766] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:19.136202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.136811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.144266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.144714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.145501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.145941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.272424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.274792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.281813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.282251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.283017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.283445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.285878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:19.298682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1ad29e4-9c16-460c-9cee-f45ca61555b6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1732 microversion: 2.1 time: 0.167204 Aug 02 09:16:19.299541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 381/767] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:19.315556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72bd39e0-2e1b-4ec2-8f9b-9da82e50ffa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Aug 02 09:16:19.316137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 387/768] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:19.321297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.321640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.327770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.328225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.329012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.329487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.410106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1fafb34b-9f2c-410e-9634-1dd900b7d623 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093509 Aug 02 09:16:19.410822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 382/769] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:19.439070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.441281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.447860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.448361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.449176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.449623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.478622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:19.484222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85bc491d-21cc-4b8f-8ab5-b8e44966acc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049173 Aug 02 09:16:19.484819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 388/770] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:20.310122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-d5a33a5c-493f-46f7-a0b8-e6bd33915ad7 req-5584df19-975c-4678-996e-5632186c40e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:20.327357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-d5a33a5c-493f-46f7-a0b8-e6bd33915ad7 req-5584df19-975c-4678-996e-5632186c40e6 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.328099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-d5a33a5c-493f-46f7-a0b8-e6bd33915ad7 req-5584df19-975c-4678-996e-5632186c40e6 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.336393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.340984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.347076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-d5a33a5c-493f-46f7-a0b8-e6bd33915ad7 req-5584df19-975c-4678-996e-5632186c40e6 service nova] Creating event network-changed:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:16:20.352309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.353635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.354686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.355721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.358707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-d5a33a5c-493f-46f7-a0b8-e6bd33915ad7 req-5584df19-975c-4678-996e-5632186c40e6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052120 Aug 02 09:16:20.359677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 383/771] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:20.392247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-65388899-9b87-4472-9c80-b79dc284089c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067114 Aug 02 09:16:20.392753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 389/772] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:20.500723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.504587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.513838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.515447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.516538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.517972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.560823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-560bbbae-f3eb-4450-b01d-a9948b4aaf93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065456 Aug 02 09:16:20.561828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 384/773] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:21.405570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:21.407755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.414606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.415056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.415831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.416271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.446151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b6e0e1cc-02f7-453f-87da-a54685d3f131 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Aug 02 09:16:21.446649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 390/774] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:21.576620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:21.578937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.585993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.586448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.587226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.587692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.618989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-93b053ad-3443-4aab-83ce-998b562db1c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046454 Aug 02 09:16:21.619556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 385/775] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:22.374651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-47d34304-717b-49ae-84da-7f94c5483f81 req-c6f4caff-7b10-4a4d-a470-7d70ef02ff3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:22.385011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-47d34304-717b-49ae-84da-7f94c5483f81 req-c6f4caff-7b10-4a4d-a470-7d70ef02ff3e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.385593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-47d34304-717b-49ae-84da-7f94c5483f81 req-c6f4caff-7b10-4a4d-a470-7d70ef02ff3e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.396598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-47d34304-717b-49ae-84da-7f94c5483f81 req-c6f4caff-7b10-4a4d-a470-7d70ef02ff3e service nova] Creating event network-changed:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:16:22.403055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-47d34304-717b-49ae-84da-7f94c5483f81 req-c6f4caff-7b10-4a4d-a470-7d70ef02ff3e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032066 Aug 02 09:16:22.403842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 391/776] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:22.458806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:22.462914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:22.469438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.470139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.470968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.471616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.504018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-85485964-0738-43ac-8afd-446f70988a9e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049104 Aug 02 09:16:22.504584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 386/777] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:22.633899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:22.636091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:22.643125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.643582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.644409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.644809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.680260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-719c374b-e5aa-4931-8661-8a07eba13415 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051840 Aug 02 09:16:22.680862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 392/778] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:23.516637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.518843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.525412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.525866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.526639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.527080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.558819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6519c86c-daac-4bac-988a-98c3ad741c0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Aug 02 09:16:23.559388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 387/779] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:23.694747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.696901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.703506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.703947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.704714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.705178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.735383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-14114c0a-d96e-4710-b091-ef0cce53dde7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045368 Aug 02 09:16:23.735942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 393/780] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:24.571429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.574185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.580737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.581221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.582010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.582446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.618000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e404d0f5-312c-4ed3-9597-379106e953d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051413 Aug 02 09:16:24.618573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 388/781] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:24.748860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.750955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.758407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.758859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.759639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.760076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.790295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ee044bb8-3cf7-4957-ba12-f5ecc810603f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Aug 02 09:16:24.790869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 394/782] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:25.631304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:25.633628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:25.640597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.641063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.641859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.642305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.672746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81c57b73-5810-4154-bdb3-aada7f4c34e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Aug 02 09:16:25.673341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 389/783] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:25.802924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:25.805948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:25.812624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.813064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.813860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.814292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.843864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-89cb8295-ffbe-44b6-8179-478c6314e336 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045094 Aug 02 09:16:25.844419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 395/784] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:26.685568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:26.687635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:26.695140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.695595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.696377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.696814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.727662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6dfda5ac-a21f-41fe-b6a7-fca38661c905 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Aug 02 09:16:26.728289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 390/785] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:26.857450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:26.859601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:26.865685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.866950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.867735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.868174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.898246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-563bebe1-0b0d-4860-afb6-c4ce617f4e7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045199 Aug 02 09:16:26.898836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 396/786] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:27.740258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:27.743682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:27.750278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.750737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.751500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.751939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.784117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef43cf22-3474-4268-9bac-8ace1784cd64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047861 Aug 02 09:16:27.784681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 391/787] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:27.912886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:27.915644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:27.923131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.923586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.924392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.924830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.957981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dafe52bf-4f17-4969-b73e-2e1233e66b7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051030 Aug 02 09:16:27.958586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 397/788] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:28.796011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:28.798360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:28.807056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.807779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.808992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.809708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.842689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e03c86f-091e-43e3-bdf4-b01d01c4355e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050552 Aug 02 09:16:28.843270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 392/789] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:28.970793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:28.973003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:28.979991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.980438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.981244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.981671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.012567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-089d9c49-e446-4410-856f-33e7127dcd41 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045938 Aug 02 09:16:29.013159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 398/790] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:29.855698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:29.857880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:29.864374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.864823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.865627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.866832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.897029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21877919-af0f-4c71-9217-9a6d1c4d2a86 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Aug 02 09:16:29.898753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 393/791] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:30.025390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.027551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.034013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.034458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.035220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.035672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.065891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9619e89-9288-4d8a-87d7-6802a0a9e643 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044449 Aug 02 09:16:30.066369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 399/792] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:30.910405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.912890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.919392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.919841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.920612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.921041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.955731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b51caee-3c1d-40e6-b89b-0c620a3ca873 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049336 Aug 02 09:16:30.956688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 394/793] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:31.084283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:31.088747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:31.095534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.095979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.096750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.097212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.129011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-77d0c468-e657-40c1-ba7b-6577bf265ca5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053258 Aug 02 09:16:31.129615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 400/794] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:31.969436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:31.971614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:31.979169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.979618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.980390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.980849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.011625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d4e095e9-7e83-4664-ac0d-b36ce2f8505c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 02 09:16:32.012204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 395/795] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:32.141928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:32.144024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:32.152158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.152615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.153425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.153862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.185190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-911d061a-9739-4e4d-9b68-c6a96a8cabaf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047371 Aug 02 09:16:32.185773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 401/796] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:33.024033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:33.026299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:33.033337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.033794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.034575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.035015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.065471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e9ce7b2-909d-4319-8abb-dc9547a87a01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Aug 02 09:16:33.066066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 396/797] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:33.198086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:33.200179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:33.206705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.207154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.207924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.208354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.239911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c27f940-6bcb-4f3d-a7b2-b4c0202557a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046762 Aug 02 09:16:33.240481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 402/798] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:34.078647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.080720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.088169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.088673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.089601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.090101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.119316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-987fc27b-826a-4d03-b511-b7372b316550 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Aug 02 09:16:34.119889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 397/799] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:34.254138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.256842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.263458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.263913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.264683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.265143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.294715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5231620-a95b-4985-937f-75a22232dc7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044841 Aug 02 09:16:34.295303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 403/800] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:35.132953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:35.135168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:35.141664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.142118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.142888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.143326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.157658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:35.173777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-af77d186-75ce-49dc-881a-6c3b071e5634 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Aug 02 09:16:35.174265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 398/801] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:35.307342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:35.309496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:35.315911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.316350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.317186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.317774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.347554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9f8b1b32-b130-404c-b692-32e9b4dcb40b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044326 Aug 02 09:16:35.348117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 404/802] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:36.186760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.188837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.191193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=76 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:36.196918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.197393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.198160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.198584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.230091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef063ec0-1493-436a-bbdc-eb5bdbe902fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047334 Aug 02 09:16:36.230657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 399/803] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:36.360179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.362418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.368982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.369460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.370226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.370659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.400984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b47747d-5717-487b-a17f-1f3f0e512317 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044795 Aug 02 09:16:36.401585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 405/804] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:37.243966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:37.246233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:37.252658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.253165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.254200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.254636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.284670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e2e37ca-edae-4c81-bf32-f84323c85ae5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 Aug 02 09:16:37.285256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 400/805] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:37.414314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:37.416468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:37.423173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.423621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.424410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.424845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.429140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:37.460291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab89f38f-3835-4b20-814c-85009a994764 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049572 Aug 02 09:16:37.461082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 406/806] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:38.298239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:38.300585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:38.307649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.308105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.308884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.309353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.338800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-37fa90f5-6cd0-408a-95d6-c0cf01fe8a11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Aug 02 09:16:38.339366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 401/807] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:38.473895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:38.476252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:38.482783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.483229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.484046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.484478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.516470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9613a3b7-7ba0-4d22-aac5-eb684a25d35d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047172 Aug 02 09:16:38.517041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 407/808] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:39.351612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.353996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.361011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.361580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.362351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.362832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.393411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ee1380df-14cb-4418-8677-7a0a408e1b16 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Aug 02 09:16:39.394069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 402/809] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:39.528942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.531181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.533494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=72 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:39.539395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.539863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.540616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.541027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.570859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8bac5c73-6435-4da9-8c3b-65f32172f1cc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045956 Aug 02 09:16:39.571420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 408/810] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:40.407014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:40.409263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:40.418226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.418685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.419463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.419907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.450002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5ce77919-b221-45b9-ab80-08da0375a42c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047159 Aug 02 09:16:40.450578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 403/811] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:40.583736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:40.586567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:40.593327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.594089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.594876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.595318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.625520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3f859ed1-7a80-428c-b1cd-1e0968315133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046028 Aug 02 09:16:40.626272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 409/812] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:41.463119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:41.465389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:41.472148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.472635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.473450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.473908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.506433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e2258da9-d8eb-49ad-b3bd-64a7a4ef51c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Aug 02 09:16:41.507586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 404/813] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:41.638815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:41.641023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:41.648336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.648783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.649711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.650432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.686504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3d36af4c-1c82-4594-8177-2d9a6b2bf855 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051757 Aug 02 09:16:41.687071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 410/814] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:42.519968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.522311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.528760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.529233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.529988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.530447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.559814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b95617f5-686d-4643-8be8-3b0db954b44b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Aug 02 09:16:42.560377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 405/815] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:42.701376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.703559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.711180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.711640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.712411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.712852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.742052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e6846227-02fb-4236-b559-540e90f667f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044735 Aug 02 09:16:42.742613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 411/816] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:43.572322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:43.574644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:43.581796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.582245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.583021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.583452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.615085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62406028-434d-4aee-a3ea-6856ef4fb072 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Aug 02 09:16:43.615824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 406/817] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:43.754965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:43.757911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:43.764569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.765019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.765908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.766275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.797781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-51207bdf-2d6a-455e-b65b-7308b05b56b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046937 Aug 02 09:16:43.798541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 412/818] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:44.627983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:44.630545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:44.637582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.638026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.638781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.639213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.669993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff70f91e-4ed6-4a61-9b7c-d210779405ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Aug 02 09:16:44.670572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 407/819] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:44.813121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:44.815336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:44.822878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.823330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.824592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.825031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.855260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-03f62682-d39b-4299-a21d-84a457418b61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046210 Aug 02 09:16:44.855833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 413/820] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:45.682949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:45.685137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:45.691716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.692167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.692976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.694034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.726671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c833f51d-565a-423b-856f-37610d1761b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047535 Aug 02 09:16:45.727180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 408/821] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:45.868924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:45.871444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:45.878097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.878810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.879576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.880011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.911360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-71716270-921f-46f1-be11-8e26d46b25d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047508 Aug 02 09:16:45.912077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 414/822] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:46.739306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:46.741506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:46.748217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.748671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.749474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.749912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.781901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfb005ee-febd-4c32-a834-abe247289ea6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046520 Aug 02 09:16:46.782474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 409/823] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:46.924153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:46.926408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:46.933201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.933652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.934429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.934865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.966440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cfbee13f-59ed-499a-9afc-9f370c08693c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046362 Aug 02 09:16:46.967039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 415/824] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:47.795302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:47.797940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:47.806279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.806986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.807721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.808283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.840263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e53df2f9-f0b1-4030-abac-860c0dfaf1db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049724 Aug 02 09:16:47.840891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 410/825] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:47.979922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:47.982275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:47.989386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.989840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.990677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.991124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.022220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-553ba88b-2cfe-4915-b910-b7b6a49b267d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046400 Aug 02 09:16:48.022801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 416/826] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:48.854057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:48.856274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:48.864488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.865668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.866548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.867076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.903480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a06f8bef-f587-4bc6-a7fb-ccbbfb130364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054897 Aug 02 09:16:48.904491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 411/827] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:49.035609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:49.038331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:49.047926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.048636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.049732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.050294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.086342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8399cc2d-bb62-405d-baa4-4d7186fc37dc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055351 Aug 02 09:16:49.086933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 417/828] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:49.916615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:49.918984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:49.925798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.926278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.927099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.927799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.957636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0171b8b3-c300-4ad7-9412-9ff41ae4b6bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Aug 02 09:16:49.958218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 412/829] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:50.098502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:50.100803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:50.107458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.107905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.108684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.109148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.139256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8fabfe1b-9414-4fdd-9cb4-2c3f33d2d94f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044921 Aug 02 09:16:50.139833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 418/830] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:50.972112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:50.975053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:50.981495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.981943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.982706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.983144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:51.011716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-04615471-6d73-4970-907f-0ff3141539f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Aug 02 09:16:51.012273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 413/831] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:51.152893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:51.155109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:51.162217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:51.162647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:51.163419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:51.163858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:51.192420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5a6ade1-b238-4177-ac64-cd3846d8b321 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043461 Aug 02 09:16:51.192911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 419/832] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:52.023459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:52.025626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:52.031954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:52.032398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:52.033178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:52.033614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:52.062799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3e9c7a24-f729-4570-9eb9-b272536f66c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 Aug 02 09:16:52.063268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 414/833] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:52.205282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:52.207417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:52.214062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:52.214498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:52.215259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:52.215684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:52.244790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-066a3584-5737-4d0b-b2c1-5f42b536a57a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043658 Aug 02 09:16:52.245372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 420/834] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:53.075061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:53.078479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:53.086067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.086518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.087300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.087740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.090300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:53.120779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-96444d56-c59d-4b22-8711-f942c914e1bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Aug 02 09:16:53.121325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 415/835] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:53.258524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:53.260914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:53.267690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.268143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.268924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.269390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.300660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2e5187cd-29ac-4ebe-876f-270a0d9ef03d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046867 Aug 02 09:16:53.301285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 421/836] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:54.134599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:54.136709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:54.150629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.151077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.151855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.152293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.181927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-12905942-f472-415d-a8d9-1919b6d32f09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052517 Aug 02 09:16:54.182482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 416/837] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:54.313298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:54.315443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:54.322316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.322763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.323529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.323967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.348743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:54.355022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bdb4901c-9e9c-4407-a95f-0574d0b057cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045926 Aug 02 09:16:54.355594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 422/838] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:55.194936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:55.197022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:55.203495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.203969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.204734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.205199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.234194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0a72823a-aa51-46f2-8df1-5552ea3ba78f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Aug 02 09:16:55.234751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 417/839] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:55.367839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:55.370010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:55.376509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.376954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.377758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.378195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.407493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ae8478a-09eb-4e01-a9bb-3ad9ba43c883 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043878 Aug 02 09:16:55.408042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 423/840] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:56.246695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:56.248805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:56.255677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.256127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.256932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.257410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.287013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e9e8528e-43bd-4875-ae49-5ac69245e1cd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Aug 02 09:16:56.287935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 418/841] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:56.420453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:56.422678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:56.429073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.429557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.430342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.430774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.462361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5a3e264-774c-4763-a6f4-6a59e7c29fc1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045952 Aug 02 09:16:56.462960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 424/842] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:16:57.299735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:57.302551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:57.309413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.309862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:57.310629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.311062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:57.339568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a8b40878-d718-43f3-8d51-3f5540ade714 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Aug 02 09:16:57.340122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 419/843] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:57.475645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:57.477819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:57.484321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.484776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:57.485575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.486018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:57.515737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0e502c13-a4f4-4542-be10-59c1fd335eb6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044676 Aug 02 09:16:57.516297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 425/844] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:58.075116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:58.075607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:58.081462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.081910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.082659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.083112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.204935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lazy-loading 'services' on Instance uuid 653f50f6-3df3-4a7a-baef-b1222520a28f {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:58.315899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f9c80fc-dd24-4945-815d-b2789a9d78fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments/f59cf3bd-aa15-4cf1-8779-3026a2361965" status: 202 len: 0 microversion: 2.1 time: 0.244483 Aug 02 09:16:58.316613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 420/845] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:16:58 2022] DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments/f59cf3bd-aa15-4cf1-8779-3026a2361965 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:16:58.325532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:58.327660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:58.334699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.335153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.336245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.336681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.352178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:58.354557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:58.361097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.361821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.362169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.362606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.366042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-48a78414-6ccb-4185-8546-a994a3801b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 02 09:16:58.367585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 426/846] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:58.393510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81394747-c25c-493c-919a-f30e0b3b5292 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Aug 02 09:16:58.394063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 421/847] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:58.528136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:58.530251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:58.536829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.537369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.538139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:58.538581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.567350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81377fe7-72b0-47c4-9070-5929b0f5be02 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043376 Aug 02 09:16:58.568496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 427/848] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:59.379046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:59.381317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:59.387741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.388195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.388962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.389436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.406695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:59.408871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:59.415616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.416067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.416871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.417350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.419730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-43c5e12b-563b-4ada-a7c4-3370fc120c50 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Aug 02 09:16:59.420501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 422/849] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:59.447398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df38d0ae-e8f3-4e22-bdae-c6d8968dc602 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Aug 02 09:16:59.447961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 428/850] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:16:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:59.580050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:59.582202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:59.588888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.589380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.590234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.590600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.618473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c99cc03a-a9e0-4ae1-a885-c286a8d9294e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042475 Aug 02 09:16:59.619014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 423/851] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:16:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:00.432265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:00.434455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:00.440887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.441372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.442141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.442701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.460060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:00.462285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:00.468403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.468850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.469681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.470115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.471885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-defd6a05-e94a-4e29-ab63-8e4c9537d375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Aug 02 09:17:00.472465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 429/852] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:00.500352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-50ff384f-0a62-462b-a3a2-f1ccd511fe3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 Aug 02 09:17:00.500910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 424/853] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:00.631224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:00.633465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:00.639527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.639970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.640728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.641216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.671909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cbef0a77-41a7-4d6f-826b-83496a4d2edc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045067 Aug 02 09:17:00.672466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 430/854] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:01.485347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:01.487464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.495098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.495552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.496341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.496785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.513937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:01.516272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.524112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.524717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.525604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.526110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.529802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad8a2479-223c-412d-a8c8-6ba0ae136c53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048525 Aug 02 09:17:01.530700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 425/855] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:01.558924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-99918704-2b1b-4761-abec-df4b82684814 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049128 Aug 02 09:17:01.559512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 431/856] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:01.684049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:01.686184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.692156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.692746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.693538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.693971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.729690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73ef07fa-b90d-4784-a37f-6a934d456f8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049492 Aug 02 09:17:01.730272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 426/857] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:02.543073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:02.545256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:02.551745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.552971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.553771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.554215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.571113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:02.573281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:02.579689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.580136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.580895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.581351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.584310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d37cdd6-ac21-40c9-906c-95ea68605028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 02 09:17:02.585666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 432/858] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:02.612445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7bbc1146-54d5-4c8c-a7b9-38a42b403cd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Aug 02 09:17:02.612984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 427/859] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:02.742619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:02.744777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:02.750825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.751275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.752044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:02.752481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.781709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b15bdd62-61aa-4224-ac3c-3ea30c1aa8f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043595 Aug 02 09:17:02.782364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 433/860] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:03.595897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:03.598023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:03.604583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.605034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.605825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.606264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.625295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:03.627617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:03.635021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.635459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.636223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.636482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-940b2744-7728-4731-818b-6873148e1721 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 02 09:17:03.636651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.637045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 428/861] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:03.666151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1efe6194-4076-4df4-948b-a3829a32717f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 02 09:17:03.666722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 434/862] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:03.795311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:03.797483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:03.804019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.804457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.805311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.805744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.843498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c32b116f-aa3d-4901-9cef-5b761ed48f1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052143 Aug 02 09:17:03.844044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 429/863] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:04.649401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:04.651633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:04.658130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.658525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.659286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.659721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.678968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:04.681211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:04.687850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.688292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.689063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.689534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.691786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bcefcbf4-da79-4e31-b973-4f47718289b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Aug 02 09:17:04.692514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 435/864] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:04.719821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d83d74aa-6851-4db9-93ba-0327507b45a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Aug 02 09:17:04.720372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 430/865] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:04.856341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:04.858527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:04.865199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.865666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.866472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.866922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.897285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1872c488-055e-437f-8fc3-9404d079c731 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045119 Aug 02 09:17:04.897849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 436/866] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:05.704276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:05.706482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:05.713235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.713689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.714456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.714895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.717391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:05.733086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:05.735254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:05.743097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.743546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.744321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.744753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.745963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15fa097d-1b9b-4b29-9d71-5e60c610c676 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Aug 02 09:17:05.746540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 431/867] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:05.774925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e3f2ccf-15e1-4806-ae4a-6d6f79502838 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Aug 02 09:17:05.775486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 437/868] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:05.912381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:05.914584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:05.920628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.921346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.921910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.922347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.951139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62e40cf0-0739-41dd-add4-e5b08bdd8352 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044334 Aug 02 09:17:05.951697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 432/869] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:06.759948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:06.762174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:06.768623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.769072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.769879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.770392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.787190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:06.789493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:06.791820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=68 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:06.797033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.797501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.798262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.798689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.800066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4261876b-8d32-48bb-bba2-6b31b39cf493 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Aug 02 09:17:06.800652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 438/870] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:06.828446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5064c3dd-f1e4-4537-bed4-876105692db1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Aug 02 09:17:06.828999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 433/871] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:06.964176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:06.966398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:06.972619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.973097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.973890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.974317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.991448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:07.005797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3bbea9e5-ff57-44e2-af64-a7fd4c2da029 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045238 Aug 02 09:17:07.006358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 439/872] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:07.813075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:07.815241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:07.822522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:07.822952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:07.823734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:07.824175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:07.840214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:07.842427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:07.849552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:07.849975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:07.850739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:07.851174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:07.854396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-704e9c75-9d7a-450a-a370-09e7fe6e6d4a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Aug 02 09:17:07.854971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 434/873] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:07.887407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b1315c5-7f1b-45cf-8205-4c2d270a53be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051129 Aug 02 09:17:07.887975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 440/874] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:08.018203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:08.020990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:08.028545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.029320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.030590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.031318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.061793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-842df672-19ec-445b-b32f-c8b4b14654da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047575 Aug 02 09:17:08.062333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 435/875] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:08.867552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:08.869945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:08.876547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.877065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.877929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.878690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.900235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:08.902400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:08.908889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.909371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.910137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.910570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.917149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6b01953f-cd58-4bca-bb49-54cc6d11a7f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052377 Aug 02 09:17:08.919971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 441/876] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:08.944037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1476b545-8e01-4c25-8067-933800f9d831 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Aug 02 09:17:08.944602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 436/877] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:09.074418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:09.076503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:09.083184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.084172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.084947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.085510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.118005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7377d44b-5094-4a90-a7a8-f6add4a01b4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047625 Aug 02 09:17:09.118583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 442/878] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:09.928825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:09.931068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:09.937595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.938049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.938824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.939258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.956628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:09.958976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:09.961432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=70 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:09.966908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.967364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.968145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.968581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.969967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73b23ca7-ea9a-48c0-b622-edd29686cde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Aug 02 09:17:09.970543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 437/879] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:10.000300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9502ff36-b0b8-43f6-ac1c-7b8f62ef1e1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048264 Aug 02 09:17:10.000873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 443/880] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:10.131337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:10.133565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:10.139973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.140425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.141230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.141668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.171260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-18e63ab1-55ca-4e89-ba14-114d491f7bee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044271 Aug 02 09:17:10.171823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 438/881] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:10.984312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:10.986070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:10.992647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.993096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.993890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.994318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.014407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:11.016561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:11.023765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.024211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.024999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.025467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.027392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dfedf5f5-f244-43d5-8fbc-84e27336f0ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Aug 02 09:17:11.027982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 444/882] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:11.055259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-341b136d-5027-4ff3-8ccc-d0af9a86efb7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 02 09:17:11.055816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 439/883] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:11.183985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:11.186080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:11.193141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.193539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.194322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.194762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.223826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-643a1164-1a6b-4c3f-bae2-6c2cd14950d8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Aug 02 09:17:11.224391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 445/884] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:12.040946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:12.043166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:12.049103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.049617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.050388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.050857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.068456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:12.070933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:12.078084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.078527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.079308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.079739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.113622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e521b132-d9a8-4882-984a-960f0fc3f094 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049691 Aug 02 09:17:12.114789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 446/885] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:12.231473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f46ffa36-3229-4a6e-9185-cbdf489c0a67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195591 Aug 02 09:17:12.232041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 440/886] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:12.236625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:12.238812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:12.244880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.245372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.246143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:12.246575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:12.276795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3502e146-9fc4-4a66-a741-ce25652e99ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044229 Aug 02 09:17:12.277396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 447/887] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:13.130582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:13.132623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:13.138897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.139343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.140111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.140544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.171395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-77e330a8-8841-4a75-b10c-5bfe125aa9ba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049223 Aug 02 09:17:13.171948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 441/888] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:13.244548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:13.246866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:13.253585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.254027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.254853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.255284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.283754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-13729a48-03af-4d79-a5d0-c162bef9522c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Aug 02 09:17:13.284327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 448/889] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:13.290263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:13.292354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:13.298402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.298855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.299615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.300050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.329244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-462a957b-259d-4920-8435-a2ddc13aa5d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043824 Aug 02 09:17:13.329797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 442/890] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:14.183651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:14.185786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:14.192611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.193061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.193864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.194312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.223434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0f799a2-63fd-4147-909c-88c43647894a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Aug 02 09:17:14.224001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 449/891] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:14.296177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:14.298355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:14.307008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.307453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.308396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.308852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.338885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-61323a97-67b7-4747-9ac1-20fb05ab86a7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046647 Aug 02 09:17:14.339446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 443/892] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:14.341492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:14.343800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:14.350398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.350849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.351624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.352093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.382239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-90b888b1-faaa-438a-8933-d9034c938582 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Aug 02 09:17:14.382812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 450/893] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:15.236630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:15.238780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:15.244962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.245441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.246209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.246646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.277232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-291ca2bb-9879-47c3-8eae-5f62e413756a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 02 09:17:15.277800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 444/894] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:15.351668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:15.353848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:15.360815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.361329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.362047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.362478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.395463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:15.397344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7837147-62df-4000-bd6c-da807f5e11b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Aug 02 09:17:15.397643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 451/895] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:15.397884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:15.405239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.405770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.406649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.407137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.441338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4efd1dca-f363-4739-ab8d-8e2bbc7f4154 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050666 Aug 02 09:17:15.442634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 445/896] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:16.291302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:16.294007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:16.300826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.301892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.302665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.303109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.332106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba9dda23-e7da-48b3-809d-4ef4abcaec27 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Aug 02 09:17:16.332678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 452/897] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:16.411614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:16.413829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:16.420294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.420734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.421523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.421950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.450982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd027dc7-65fa-42db-b33e-be6167f4a1ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Aug 02 09:17:16.451528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 446/898] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:16.455225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:16.458692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:16.464317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.464766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.465553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.465992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.496510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5584c722-6584-46a3-b123-edb08a508368 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045352 Aug 02 09:17:16.497083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 453/899] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:17.345306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:17.347630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:17.353983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.354438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.355209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.355688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.383449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:17.388379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0310026d-0551-4f14-9cec-cf7e0a6b0ba9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047592 Aug 02 09:17:17.388939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 447/900] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:17.462479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:17.464632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:17.471131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.471581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.472353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.472793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.501973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3880d31c-5062-40b8-b043-a8e3e9f4053d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Aug 02 09:17:17.502532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 454/901] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:17.510299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:17.512427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:17.518784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.519235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.520047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.520487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.551872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2d889955-de91-45c9-95b9-f19bb49d8df9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044980 Aug 02 09:17:17.552454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 448/902] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:18.401393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:18.403585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:18.409679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.410133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.410961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.411405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.439930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c965b5dd-c2b2-42a1-a29b-5a281b28fc9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042785 Aug 02 09:17:18.440499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 455/903] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:18.515802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:18.517970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:18.525421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.525876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.526640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.527172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.557365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-441f0e86-486a-4254-af57-344ac20e2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Aug 02 09:17:18.557936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 449/904] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:18.565051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:18.567950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:18.574742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.575188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.575957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:18.576395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.580004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:18.606083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-46c7c9a3-9f46-45d6-9531-b87441a57938 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044996 Aug 02 09:17:18.606646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 456/905] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:19.453471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:19.455620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:19.462384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.462843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.463648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.464085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.493471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b9bbf3c-ce21-4509-80a9-6c53c30d53d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 02 09:17:19.494030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 450/906] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:19.569629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:19.571812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:19.578339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.578789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.579553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.579988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.609524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdb0ba49-834c-4393-a0ec-f04e59b0a99b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Aug 02 09:17:19.610082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 457/907] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:19.620312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:19.622475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:19.629294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.629747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.630712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.631145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.659607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3922fe93-2d90-4e40-9569-8319adf990fc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044029 Aug 02 09:17:19.660179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 451/908] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:20.507149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:20.509362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:20.515410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.515869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.516646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.517084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.546558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7efb6ece-366f-4291-b6e3-da14f3725f84 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Aug 02 09:17:20.547157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 458/909] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:20.622381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:20.624554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:20.631415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.631864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.632640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.633083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.662578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-901fe8d2-2abf-48ca-a00f-1045b43e6028 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Aug 02 09:17:20.663134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 452/910] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:20.673070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:20.675550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:20.683520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.684015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.684922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.685479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.717375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3705b5a-1663-419a-a223-20f4ed6f3770 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049049 Aug 02 09:17:20.717935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 459/911] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:21.559539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:21.561698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:21.568365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.568965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.569762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.570191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.598431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4ee39591-3cdb-4497-b941-69ad8745ff9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Aug 02 09:17:21.598976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 453/912] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:21.675009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:21.677898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:21.684376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.684823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.685625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.686082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.716656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa0e5ea3-6711-4075-86bc-5078d5912c8d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Aug 02 09:17:21.717246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 460/913] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:21.730491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:21.732609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:21.739775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.740231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.740999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.741473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.770477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d36922f6-a2f7-4f80-8ae6-932ee7fc2111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044632 Aug 02 09:17:21.771026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 454/914] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:22.610699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:22.612829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:22.619308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.619746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.620500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.620927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.650845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-09a58ef3-f120-4a92-8e54-122f0fef33f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Aug 02 09:17:22.651499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 461/915] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:22.730916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:22.733527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:22.740219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.740670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.741472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.741941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.771795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-25f06221-aacc-40f6-bae9-c622d3520c7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046216 Aug 02 09:17:22.772344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 455/916] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:22.783111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:22.785300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:22.791836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.792324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.793102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.793565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.822342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0ec742e-ece7-43c0-aba3-8f6dca1a7455 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043613 Aug 02 09:17:22.822904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 462/917] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:23.664549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:23.666705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:23.672925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.673405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.674170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.674607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.711993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a0961c0e-1493-4c38-b99f-b8effd1ae948 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052466 Aug 02 09:17:23.712577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 456/918] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:23.784652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:23.787347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:23.793791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.794236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.794990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.795422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.824233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-14cd832a-b936-4c2b-9c82-44a6a4497be0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Aug 02 09:17:23.824789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 463/919] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:23.835153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:23.837344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:23.843827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.844282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.845086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.845554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.876534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b9af6a32-b089-4b98-bf48-98b1dc94bd85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045799 Aug 02 09:17:23.877092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 457/920] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:24.724957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:24.727163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:24.733473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.734003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.734709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.735164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.766417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c6c59e81-9390-4a8e-b0d9-ca8990b47a03 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Aug 02 09:17:24.766994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 464/921] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:24.836861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:24.838951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:24.845367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.845812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.846566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.847027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.880189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f4508542-2344-4155-ae0f-2f04f011e51c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Aug 02 09:17:24.880744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 458/922] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:24.889431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:24.891736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:24.898848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.899365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.900235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.900675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.934634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45b14ecd-4745-4e9e-a922-a765ae1f8713 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049074 Aug 02 09:17:24.935367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 465/923] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:25.778961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:25.781209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:25.787472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.787921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.788716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.789207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.819361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8dd57466-172e-4339-9016-32959c9f1d41 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Aug 02 09:17:25.819914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 459/924] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:25.895328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:25.898026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:25.904813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.905335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.906117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.906551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.936568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60f99d49-59cc-48f0-991b-59986362b569 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048026 Aug 02 09:17:25.937155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 466/925] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:25.948048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:25.950324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:25.956820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.958334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.959105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.959548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.987931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a37e331-5325-4cc0-9f94-7501cfe6e6ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043862 Aug 02 09:17:25.989096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 460/926] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:26.832205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:26.834353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:26.840529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.840982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.841796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.842234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.872119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-36d8d1a0-6778-4b2e-a23d-fdab8854805f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 02 09:17:26.872713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 467/927] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:26.949498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:26.951657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:26.958547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.958999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.959760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.960197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.988901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-804d38ca-ea8e-4318-ab69-848f1b991259 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Aug 02 09:17:26.989482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 461/928] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:27.001393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:27.003986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:27.010227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.010674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.011434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.011867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.041633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-457af104-1c91-4ded-9fc8-ac0f0bd58c93 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 Aug 02 09:17:27.042213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 468/929] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:27.885735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:27.887887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:27.894552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.895158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.895752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.896194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.926625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5195e59e-17c0-49d1-b936-43a14184a437 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 02 09:17:27.927196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 462/930] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:28.006828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:28.010362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:28.017189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.017641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.018440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.018880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.048052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0dc7a271-cf85-48f3-ac1e-04553442777d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049687 Aug 02 09:17:28.048928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 469/931] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:28.054671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:28.056767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:28.063849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.064356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.065353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.065935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.094624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-51a07ecc-cb42-4c03-9cef-6284118d3f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044561 Aug 02 09:17:28.095258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 463/932] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:28.938845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:28.941571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:28.948361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.948807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.949614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:28.950059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:28.979695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a630fb0a-0ba8-4e37-b187-23cf09c6aa8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Aug 02 09:17:28.980344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 470/933] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:29.059959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:29.062180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:29.069967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.070418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.071181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.071617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.086606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:29.103069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-303b1ea4-acf3-4ef6-b123-dee76e68a07d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Aug 02 09:17:29.103625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 464/934] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:29.108167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:29.110354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:29.117162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.117568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.118341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:29.118776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:29.148670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-544e916a-3cbc-418a-ade9-da75af70792c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044874 Aug 02 09:17:29.149255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 471/935] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:29.992213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:29.994390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:30.000476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:30.000933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.001749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:30.002212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.031777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-248a658d-2a2d-4430-b4cb-bedd66e6f26f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Aug 02 09:17:30.032332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 465/936] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:30.115404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:30.117477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:30.124011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:30.124452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.125244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:30.125686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.152005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:30.156709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d2dd8124-a68a-4467-814e-9d301a3b4a3f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045874 Aug 02 09:17:30.157304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 472/937] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:30.162178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:30.164353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:30.172390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:30.172847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.173663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:30.174101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:30.202989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ba2140ae-3cbf-4671-bb61-fc6a5b0b10be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045470 Aug 02 09:17:30.203549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 466/938] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:31.047596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:31.049770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:31.056838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.057323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.058088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.058519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.090515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ee79926-8100-4c62-89dc-eb3449b31835 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048575 Aug 02 09:17:31.091109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 473/939] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:31.170158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:31.172375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:31.179409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.179895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.180671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.181132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.209663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed916cec-5729-4c9a-8585-3852bc8d2c83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Aug 02 09:17:31.210227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 467/940] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:31.215969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:31.218157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:31.225624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.226067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.226831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:31.227267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:31.257125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0ad53e93-73ab-4c50-aa2d-5eda6db6e2d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045019 Aug 02 09:17:31.258020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 474/941] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:32.103806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:32.105901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:32.111983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.112435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.113516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.113946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.144658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6202035f-773c-4368-a955-552833d34592 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Aug 02 09:17:32.145698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 468/942] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:32.221518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:32.224142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:32.230588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.231036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.231798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.232231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.263245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a828ab3a-fff3-4ade-b3ac-92c816475a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Aug 02 09:17:32.263811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 475/943] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:32.269719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:32.271851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:32.278698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.279145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.279914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:32.280351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:32.310589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc85782f-38c1-4f99-97dd-8d3b8923a6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044759 Aug 02 09:17:32.311137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 469/944] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:33.157588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:33.160500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:33.166582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.167029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.167788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.168224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.198670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d92be07a-bd99-4e52-b135-4e5c29bb3340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Aug 02 09:17:33.199150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 476/945] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:33.276973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:33.279152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:33.286881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.287328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.288103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.288583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.319507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ca79c783-a58b-4c9d-8996-6e244cb64e58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 Aug 02 09:17:33.320100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 470/946] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:33.322908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:33.325338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:33.332463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.332974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.333769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.334199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.365180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39a1e9e5-0f35-438c-b292-8f02bafaa4f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046487 Aug 02 09:17:33.365753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 477/947] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:34.211221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:34.213378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:34.219366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.219807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.220566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.220995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.259706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5337b65c-254d-42d9-a61b-59dabdd079c1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 Aug 02 09:17:34.260283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 471/948] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:34.332361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:34.334529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:34.341062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.341537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.342299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.342727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.373102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-413631d2-cb9f-4161-ae4b-316733978d26 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 02 09:17:34.373697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 478/949] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:34.378517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:34.380684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:34.387213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.387665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.388445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:34.388889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:34.418759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1ee4a3b9-91b2-4243-ba4a-9a0c94d46f0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044758 Aug 02 09:17:34.419378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 472/950] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:35.272498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:35.274968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:35.281235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.281682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.282452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.282892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.312827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7a24f25-f58f-4f8e-b950-5c4746978542 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Aug 02 09:17:35.313433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 479/951] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:35.385604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:35.387767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:35.394874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.395326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.396096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.396533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.426088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c1b6a486-3016-4722-b1a6-daab0d5e58c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Aug 02 09:17:35.426646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 473/952] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:35.433165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:35.435364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:35.442146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.442713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.443495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.443936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.473999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5c3be4c-cd3f-458a-be1d-8438b1b35c00 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046105 Aug 02 09:17:35.474560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 480/953] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:36.326297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:36.328447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:36.335034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.335491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.336256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.336696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.366249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bc3b57ff-a47e-4288-91d1-640818ffdfda tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Aug 02 09:17:36.366810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 474/954] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:36.439912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:36.442272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:36.448829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.449320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.450096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.450534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.480527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0098f305-187b-4a3b-9a5a-e5ac031a6e89 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 02 09:17:36.481348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 481/955] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:36.486622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:36.488772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:36.495363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.495808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.496565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:36.496997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:36.526550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7ca7aae5-bb9b-41e1-acde-2ec86a134b37 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043850 Aug 02 09:17:36.527110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 475/956] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:37.379768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:37.382000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:37.388105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.388546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.389339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.389775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.418779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9036d813-59b5-4431-947f-a061520eb4d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Aug 02 09:17:37.419335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 482/957] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:37.493641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:37.495768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:37.498053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=86 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:37.504048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.504488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.505307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.505743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.535602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-282e00d6-fd91-4748-8331-f866f3623690 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046092 Aug 02 09:17:37.536174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 476/958] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:37.540125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:37.542301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:37.548828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.549321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.550734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:37.551519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:37.583499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a67023d0-9e78-4472-89f7-759213ac1cf2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047678 Aug 02 09:17:37.584062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 483/959] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:38.431356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:38.433594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:38.439622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.440067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.441989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.442431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.472682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4308b850-765d-4c40-8eff-e166bfa1880f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Aug 02 09:17:38.473267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 477/960] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:38.548216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:38.552135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:38.558772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.559218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.559988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.560424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.590943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3de57960-241e-43b6-9ec0-5505cae04da3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046735 Aug 02 09:17:38.591510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 484/961] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:38.597286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:38.599780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:38.606200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.606644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.607403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.607836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.638659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b9ae637f-5646-483b-9c29-8eac3c3ec970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045895 Aug 02 09:17:38.639273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 478/962] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:39.485481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:39.487646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:39.494145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.494645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.495479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.495905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.526829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a17ce701-9f3c-4a49-af67-80da92e6cbd0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Aug 02 09:17:39.527388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 485/963] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:39.602997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:39.605152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:39.611559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.612001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.612759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.613409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.642316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-608db717-f2b2-41a4-8220-4f2cd941d590 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 Aug 02 09:17:39.642870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 479/964] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:39.651410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:39.653591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:39.660628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.661067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.661897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:39.662323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.692783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32bd742a-05ff-4ee5-bc8b-9041a62c9132 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045268 Aug 02 09:17:39.693390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 486/965] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:40.539879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:40.542117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:40.548099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.548546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.549331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.549764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.579599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-14a207d3-ca2f-45f8-a66c-e9f1001cdee9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Aug 02 09:17:40.580148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 480/966] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:40.655257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:40.657441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:40.660470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=88 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:40.665846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.666287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.667053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.667484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.697091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-251fd1cc-c5db-46fa-806e-b168fac8cea4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Aug 02 09:17:40.697695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 487/967] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:40.705362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:40.707811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:40.714245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.714691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.715447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:40.715876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:40.718251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:40.746316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-753766be-8800-4ec0-9887-7844560222e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045053 Aug 02 09:17:40.746883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 481/968] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:41.592445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:41.594706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:41.601712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.602162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.602944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.603379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.633296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01275f23-2927-4939-8694-8bba258a521f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Aug 02 09:17:41.633859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 488/969] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:41.710399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:41.712564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:41.719061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.719507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.720277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.720712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.750674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-86d9123a-2ce0-4fbe-b25e-38d54343ebc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Aug 02 09:17:41.751236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 482/970] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:41.759396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:41.761578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:41.767972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.768417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.769895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.770324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.787617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:41.801162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4830f034-309d-4b8a-9ee4-05750bf72198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045872 Aug 02 09:17:41.801740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 489/971] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:42.645800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:42.647922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:42.653959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.654402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.655197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.655629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.685967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-37fbb200-919c-474b-b392-239e590f023e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 02 09:17:42.686530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 483/972] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:42.763649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:42.765820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:42.772960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.773553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.774327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.774764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.808678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b4d108d0-5d43-45b5-821a-bb6143c996dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Aug 02 09:17:42.809324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 490/973] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:42.813210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:42.816560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:42.822354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.822798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.823567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.823998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.855133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0da81434-a96d-4be2-9b2d-9f5d3bab3905 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045995 Aug 02 09:17:42.855698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 484/974] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:43.699277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:43.701461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:43.708826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.709307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.710088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.710521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.740764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-724bffe4-776e-4d46-b597-80db16bd96f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Aug 02 09:17:43.741433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 491/975] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:43.821668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:43.823789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:43.830333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.830780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.831851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.832281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.861271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0f8cf5cd-aab3-423b-bde2-443cdbcddd40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Aug 02 09:17:43.861820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 485/976] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:43.868834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:43.871121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:43.879134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.879773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.880555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.880995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.910726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-321f2c18-043a-4777-be97-6686f5f35108 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046014 Aug 02 09:17:43.911303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 492/977] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:44.753577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:44.755704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:44.761826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.762269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.763026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.763463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.793569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1b27ba34-406e-45fe-bbba-fa4e72b19258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Aug 02 09:17:44.794128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 486/978] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:44.874153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:44.876386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:44.884102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.884482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.885302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.885750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.916688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b895f00-e35c-4fe7-ae2a-ec758eb0cd8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046493 Aug 02 09:17:44.919360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 493/979] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:44.926496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:44.928626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:44.935118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.935561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.936352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.936791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.967929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2182162-e95b-4e49-96e6-39abf417d021 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045326 Aug 02 09:17:44.968493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 487/980] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:45.807387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:45.809745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:45.815966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.816502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.817307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.817736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.849904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18c01d1e-6358-48a8-97d2-e1c62f115e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046714 Aug 02 09:17:45.850573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 494/981] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:45.930551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:45.932719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:45.939636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.940085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.940865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.941356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.970573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c852340-c742-43cf-b9fe-aa12ca1875f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 02 09:17:45.971133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 488/982] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:45.980291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:45.982491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:45.990108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.990555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.991326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.991761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.021964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-938d9e91-a771-4d9f-acc1-6987e3ceb96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045710 Aug 02 09:17:46.022468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 495/983] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:46.862542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:46.864899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:46.871003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.871448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.872212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.872647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.903372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6b11925e-aa18-4276-9468-59758cfa61b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Aug 02 09:17:46.904196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 489/984] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:46.983528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:46.985757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:46.992640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.993089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.993901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.994341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.024261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-27261481-7654-41bb-96cb-bb265501832d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Aug 02 09:17:47.024860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 496/985] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:47.033682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:47.036738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:47.043231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.043668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.044427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.044854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.073810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2823be58-e5e9-4846-a0e3-d3b9f546e18b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044196 Aug 02 09:17:47.074358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 490/986] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:47.915869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:47.918114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:47.924942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.925409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.926176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.926600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.957492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5cc1944-2de4-4156-90a1-6161e0fccd57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Aug 02 09:17:47.958063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 497/987] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:48.036630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:48.038786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:48.045162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.045611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.046369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.046823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.075780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-de36410c-8787-454d-8732-60096f8ed78b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Aug 02 09:17:48.076343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 491/988] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:48.086391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:48.089060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:48.095764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.096157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.097574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.097910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.127093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-14678117-312a-4c7c-ad1b-3fc94d40cdb5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044825 Aug 02 09:17:48.127671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 498/989] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:48.970321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:48.972736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:48.978901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.979347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.980314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.980615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.010096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d8aeaa8-7a12-4b79-bde8-ce5d4f7b4105 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Aug 02 09:17:49.010647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 492/990] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:49.088124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:49.090273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:49.096821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:49.097300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.098096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:49.098584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.129615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-09ab4ba4-8cfe-4886-b412-e13dee11a802 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Aug 02 09:17:49.130194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 499/991] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:49.139889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:49.142099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:49.148752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:49.149246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.150021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:49.150461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.180753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7c6ae472-937d-4316-9aff-362db0f16f43 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044719 Aug 02 09:17:49.181273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 493/992] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:50.022686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:50.024825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:50.030958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.031405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.032166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.032603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.062498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8151e563-e554-4617-ab81-16cd9c0fc104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Aug 02 09:17:50.063056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 500/993] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:50.142019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:50.144642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:50.151536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.151990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.152761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.153226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.183470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ebc020cd-be80-4396-989b-26d960a04090 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 02 09:17:50.184039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 494/994] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:50.194063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:50.196217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:50.203349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.203845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.204659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.205162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.235431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-084042bb-16f4-4ef0-9b21-8bb9cc70b4ec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045914 Aug 02 09:17:50.236012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 501/995] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:51.075781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:51.078115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:51.089323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.090164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.091163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.091649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.126714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-acad578f-67ec-42a3-a119-b6a8aad0d9ea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054768 Aug 02 09:17:51.127293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 495/996] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:51.196989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:51.200373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:51.209593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.210049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.210864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.211307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.243583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cb32b74c-6148-43b2-a1cc-6a4316dfb033 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052006 Aug 02 09:17:51.244170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 502/997] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:51.251797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:51.254642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:51.261961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.262393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.263230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:51.263667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.296469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1845fbd3-9a5e-4ad5-b72d-94a2f815e9de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051925 Aug 02 09:17:51.297309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 496/998] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:52.139323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:52.141423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:52.147498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.147939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.148692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.149134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.178251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a78eea45-c05c-4367-9caa-93d27cfcd8ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042973 Aug 02 09:17:52.178815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 503/999] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:52.259870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:52.262056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:52.271374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.271898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.272927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.273652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.307160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:52.309995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:52.312712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:52.313824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d683d461-108d-4370-8ad6-24a78a62b34f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057906 Aug 02 09:17:52.314418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 497/1000] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:52.320017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.320499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.321316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.321756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.350483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f2615f5e-d1be-4580-9595-e9ea5ce418de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044723 Aug 02 09:17:52.351112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 504/1001] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:53.193261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.193839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.199837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.200287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.201087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.201587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.231975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-da579bd8-6ec5-4ef8-8a85-179cd0250a56 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Aug 02 09:17:53.232536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 498/1002] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:53.327241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.329414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.336112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.336567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.337360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.337797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.363646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.365962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.368614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-587082d6-d107-4424-b419-0210feaf0af5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Aug 02 09:17:53.369204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 505/1003] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:53.373894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.374349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.375179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.375616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.404485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9fe41db8-f6a6-4296-a132-3470519a364b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045516 Aug 02 09:17:53.405036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 499/1004] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:54.244125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.246272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.253077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.253764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.254542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.254985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.258701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:54.284226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df15f7eb-e59c-44b3-9f58-a0ee1619ee62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Aug 02 09:17:54.284788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 506/1005] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:54.381892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.384026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.390490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.390937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.391692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.392121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.417367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.419539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.420428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bec7795c-ebf2-4eb6-a516-d3f4faef2592 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Aug 02 09:17:54.421093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 500/1006] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:54.426535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.426989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.427763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.428207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.457188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4802de49-7c70-479b-8edf-a9469d9fee61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043836 Aug 02 09:17:54.457747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 507/1007] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:55.296718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.298897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.304944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.305428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.306191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.306626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.336458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-33884260-8861-4f25-ba4e-c7cd6b429a3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 02 09:17:55.337017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 501/1008] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:55.433276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.435416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.442456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.442899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.443653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.444081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.469419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.471789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.473270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-669ebc6d-e895-4f93-8c7b-21990f4edcc8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 Aug 02 09:17:55.473838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 508/1009] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:55.478243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.478701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.479476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.479914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.509173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-efc355e3-f509-44a8-976a-bc274b47d943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043696 Aug 02 09:17:55.509735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 502/1010] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:56.350026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.352772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.362173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.362637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.363537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.364026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.394633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-de709efb-8f25-4378-8854-57579736ed66 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049896 Aug 02 09:17:56.395193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 509/1011] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:56.485607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.487815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.494892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.495671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.497020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.497851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.522219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.524401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.530457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.530910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.531686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.532126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.534095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f6aaf2f7-cf8d-4ee1-bc8f-c66af3692d6b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052469 Aug 02 09:17:56.534658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 503/1012] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:56.570487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c5c74c5-b5c4-4943-a29a-1a5ff937a217 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052747 Aug 02 09:17:56.571103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 510/1013] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:57.408018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:57.411057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:57.417157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.417612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.418420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.418859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.447424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5274558d-217b-4f9c-99cc-68e6b1c08f64 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Aug 02 09:17:57.447914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 504/1014] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:57.546443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:57.548573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:57.555178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.555630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.556398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.556838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.584284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:57.586242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8d2d93f-89c0-4d84-9c99-1c95b0efaac0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Aug 02 09:17:57.586473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:57.586816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 511/1015] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:57.593033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.593513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.594278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.594707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.623898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3127431d-7073-4f53-915b-42c0bce33b2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044201 Aug 02 09:17:57.624448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 505/1016] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:17:58.459800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:58.461927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.468064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.468514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.469313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.469750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.499628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdb978bb-aa40-4b0e-8fb8-5eeadde9f558 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Aug 02 09:17:58.500182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 512/1017] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:58.599356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:58.601598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.608301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.608758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.609596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.610037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.636356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:58.638589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.643161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ea31fe8f-405b-4983-a87a-acb8ac589778 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048225 Aug 02 09:17:58.644090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 506/1018] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:58.645622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.646073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.646858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.647292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.679041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c9ac2a3-9377-46ed-8ca7-7416c3817d3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046675 Aug 02 09:17:58.679626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 513/1019] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:58.980474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:58.981002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.986998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.987442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.988222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.988651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.010726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lazy-loading 'flavor' on Instance uuid 64272d61-0647-41fa-960d-d71df9c72c70 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:17:59.081473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0a3bcd51-8e0b-4952-8cab-d9cf8c9d039a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "POST /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70/action" status: 202 len: 0 microversion: 2.1 time: 0.103946 Aug 02 09:17:59.082045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 507/1020] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:17:58 2022] POST /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:17:59.091119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.091744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.100135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.100792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.101637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.103170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.237240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:59.244822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f007710e-ac3e-46a3-9499-9b8631be5e3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157807 Aug 02 09:17:59.245435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 514/1021] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:59.512935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.515247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.522236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.522694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.523471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.523936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.553415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c64880a-d3cc-449e-b701-65c9c5fc44b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Aug 02 09:17:59.553972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 508/1022] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:59.655120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.657398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.664202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.664655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.665460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.665899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.691519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.694078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.696272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c1cbe708-d731-4351-a14f-125b5e05c78d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 02 09:17:59.696862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 515/1023] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:59.700784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.701268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.702078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.702515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.730903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-581d171b-3d7f-45b8-b52d-4099ae00fb9c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044199 Aug 02 09:17:59.731451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 509/1024] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:00.267402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.268167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.276131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.276579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.277405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.277844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.430837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:00.438396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fac55fa1-73d6-4272-8286-49b54cc9b0ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.174913 Aug 02 09:18:00.438965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 516/1025] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:00.566383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.568450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.574743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.575194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.575958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.576394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.604639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d90b4688-0db6-40f8-a131-e3a775d53a59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Aug 02 09:18:00.605213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 510/1026] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:00.708196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.710437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.716919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.717413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.718190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.718629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.743915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.746086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.749360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18b3a150-c422-4460-ae2f-975716390a4e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 Aug 02 09:18:00.749946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 517/1027] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:00.752363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.753144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.754104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.754542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.784126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-28815a66-c9fe-4407-b301-2431a08e9dad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043616 Aug 02 09:18:00.784685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 511/1028] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:00.954623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.955211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.962147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.962595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.963369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.963804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.991925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:01.071501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-379b09e1-25a7-4f18-9d92-0fc87d6b4abc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 204 len: 0 microversion: 2.1 time: 0.120536 Aug 02 09:18:01.072323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 518/1029] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:18:00 2022] DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:18:01.080792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.081638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.089683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.090771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.092567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.093596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.114842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:01.240929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:01.248759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-763eb397-c503-4e5d-b296-703f5edccd9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1582 microversion: 2.1 time: 0.172380 Aug 02 09:18:01.249374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 512/1030] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1582 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:01.460412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.461138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.467193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.467640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.468416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.468853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.611336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:01.616589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.618790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.623290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5d1e3ec6-5743-4ecf-bc67-01b546c4e85f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166944 Aug 02 09:18:01.624050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 519/1031] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:01.625752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.626365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.627381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.628291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.658750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-576bf70e-938b-4af2-b923-1357e751a71f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Aug 02 09:18:01.659327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 513/1032] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:01.762083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.764303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.772005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.772450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.773246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.773682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.796349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.798504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.804420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db14f1c9-94f2-4000-bd92-90b79fc4a483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Aug 02 09:18:01.804994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 520/1033] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:01.805639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.806091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.806864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.807297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.837659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5235e274-f263-4838-ab32-2668120c63ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045312 Aug 02 09:18:01.838212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 514/1034] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:02.271498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.272111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.279129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.279882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.281190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.281859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.289934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:02.456273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.464029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ac5ce3e7-f7e4-4b07-80f7-d93112908113 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1582 microversion: 2.1 time: 0.196434 Aug 02 09:18:02.464927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 521/1035] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1582 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:02.650780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.651394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.657988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.659014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.659795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.660223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.671369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.673750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.680514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.680962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.681777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.682214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.822583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.831986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-23360ab2-d037-4b54-b61d-660f53c4ee15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.185007 Aug 02 09:18:02.832573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 515/1036] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:02.837717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.840042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.849293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.849894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.850677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.851247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.863356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ce646ce-30f0-4b56-b77d-cf89e885924a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196160 Aug 02 09:18:02.863949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 522/1037] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:02.868611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.870760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.876598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.877103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.878291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.878924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.887426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc437e9a-22f4-4a52-a3b7-109d4cbb1b59 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053556 Aug 02 09:18:02.888185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 516/1038] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:02.909852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-38f583bb-b7cd-442b-8697-37a7973e69c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044836 Aug 02 09:18:02.910417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 523/1039] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:03.485839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.486562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.492647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.493097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.493884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.494317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.712459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:03.720240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-616b24c2-f523-441d-b963-047d05342f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1582 microversion: 2.1 time: 0.238304 Aug 02 09:18:03.721431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 517/1040] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1582 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:03.853971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.854613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.861266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.862245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.863054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.863487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.876623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.879363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.885981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.886499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.887332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.887943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.937981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-50473a01-f398-402f-9308-a4bf104cb777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066099 Aug 02 09:18:03.943089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 518/1041] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:03.948996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.951410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.958077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.958526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.959297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.959724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.997551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d4f0dd6e-f52e-4cbd-8829-207871d8c894 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053224 Aug 02 09:18:03.998617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 519/1042] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:04.004215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.006854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.014036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.014483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.015253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.016118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.028282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.038384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-942e2fec-8959-4ca2-ac7b-cda77dc4c02f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.188225 Aug 02 09:18:04.040669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 524/1043] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:04.064836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b730f166-e961-4ca0-9ed8-705c2bd95d19 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064902 Aug 02 09:18:04.070281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 520/1044] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:04.117812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-d3a4e68d-f52c-4736-828a-d7c5825505f0 req-573f0cba-b65c-453f-ad0c-4033159c88c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740332a9-5b49-41cf-9db1-ec96264ed7fd", "name": "network-vif-deleted", "tag": "87c73e63-4764-4978-b58d-e5e8146a5f51"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:04.128424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-d3a4e68d-f52c-4736-828a-d7c5825505f0 req-573f0cba-b65c-453f-ad0c-4033159c88c1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.128876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-d3a4e68d-f52c-4736-828a-d7c5825505f0 req-573f0cba-b65c-453f-ad0c-4033159c88c1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.140350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-d3a4e68d-f52c-4736-828a-d7c5825505f0 req-573f0cba-b65c-453f-ad0c-4033159c88c1 service nova] Creating event network-vif-deleted:87c73e63-4764-4978-b58d-e5e8146a5f51 for instance 740332a9-5b49-41cf-9db1-ec96264ed7fd on hv-cinder-80382 Aug 02 09:18:04.146007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-d3a4e68d-f52c-4736-828a-d7c5825505f0 req-573f0cba-b65c-453f-ad0c-4033159c88c1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103267 Aug 02 09:18:04.146628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 525/1045] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:04.741998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.742650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.749688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.750083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.750872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.751318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.820331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.828064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-33b26a3f-d806-40b4-b071-1c6269386431 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089964 Aug 02 09:18:04.828993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 521/1046] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:04.951610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.954009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.960583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.961134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.961994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.962438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.993239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a9b1a495-c59b-43fe-a4e8-7c6bd9e7dbbf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Aug 02 09:18:04.993804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 526/1047] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:05.009919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.012157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.018451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.018897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.019709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.020152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.050610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-12e6e35f-5491-4060-9dc5-dba11bc4f345 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Aug 02 09:18:05.051163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 522/1048] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:05.065691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.066307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.073567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.074031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.074830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.075268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.077430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.079593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.085407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.085858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.086627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.087067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.117840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3aeeaf6c-8d00-494f-ba47-b8f54287e450 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Aug 02 09:18:05.118417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 523/1049] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:05.210963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.218476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd01e37a-18e0-4cfe-9eee-d86676349d72 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157375 Aug 02 09:18:05.219039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 527/1050] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:05.848894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.849531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.856052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.856787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.857401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.857710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.919411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.927963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0dbf3249-74f0-4c2c-8cec-4ac27199f5c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084005 Aug 02 09:18:05.928542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 524/1051] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:06.006440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.008583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.015098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.015548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.016322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.016764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.047325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-84bbfcba-c82a-4f12-be91-83823f9ecb39 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Aug 02 09:18:06.047879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 528/1052] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:06.063001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.065674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.071565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.072007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.072761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.073220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.103605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-60e878bb-f1c4-41af-aa4f-bed8a93a87e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Aug 02 09:18:06.104074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 525/1053] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:06.131120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.133263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.139351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.139801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.140576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.141013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.170016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5e043c28-fdd6-4a37-8a00-0ea9125e68af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043916 Aug 02 09:18:06.170566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 529/1054] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:06.240201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.240839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.242679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:06.247995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.248445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.249242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.249684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.381042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:06.388487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3a6f65f2-4def-43b7-ba24-578b167c82b7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152570 Aug 02 09:18:06.389048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 526/1055] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:06.948042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.948869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.955960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.956407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.957213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.957650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.016620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.024646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f88f2373-1b84-4963-afb4-e2a17b70249d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080489 Aug 02 09:18:07.025228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 530/1056] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:07.058947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.061084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.068091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.068650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.069352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.069798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.099315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d92458a9-8a75-4754-a7bb-56b76396d9a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Aug 02 09:18:07.099879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 527/1057] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:07.116122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.118372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.124445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.124893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.125685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.126118 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.154956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b73399ad-9641-4060-a5c9-20cc75419027 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042768 Aug 02 09:18:07.155509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 531/1058] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:07.181721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.183820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.190669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.191122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.191890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.192329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.220981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31917fc5-453a-4436-9307-0f8f55853ca0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043313 Aug 02 09:18:07.221557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 528/1059] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:07.410276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.410929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.416877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.417366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.418137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.418574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.552563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.560117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6c116648-3b31-4b64-811a-62273e25802d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154036 Aug 02 09:18:07.560671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 532/1060] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:08.045227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.045846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.052006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.052459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.053280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.053709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.056234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:08.111973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.114094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.120176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:08.120705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.121180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.121956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.122572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.128220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a9d3a566-1dd4-4bc8-97b2-ed869ddee89f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086524 Aug 02 09:18:08.128790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 529/1061] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:08.151945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ac0e416-0a5a-48bb-bd3a-e47f7d866fe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Aug 02 09:18:08.152499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 533/1062] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:08.167178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.169433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.175677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.176130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.176899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.177370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.207113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5b999880-8139-4201-85b6-7331c3505a1d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Aug 02 09:18:08.207676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 530/1063] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:08.233386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.235566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.237782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:08.242984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.243440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.244209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.244653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.274993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1cabd284-4cab-4a88-86e7-45dec12785f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045688 Aug 02 09:18:08.275547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 534/1064] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:08.581904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.582580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.588910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.589483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.590281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.590720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.735216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:08.744037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6ced2280-ce3a-4bc8-b2bd-770e5e0374ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166613 Aug 02 09:18:08.744601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 531/1065] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:09.149361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.149909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.156530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.156972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.157866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.158933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.164462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.166704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.173071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.173559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.175366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.175811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.204923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7333429b-c914-4ddc-8a00-52f77c0f76af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 02 09:18:09.205968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 532/1066] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:09.219374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.220497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:09.222290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.228368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.228815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.228939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-afc03f0c-b6b9-4916-830e-528d9f28190d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083598 Aug 02 09:18:09.229476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 535/1067] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:09.229639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.230072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.260680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d322dfc-9b4c-4123-beae-e73f1f922d11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Aug 02 09:18:09.261257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 533/1068] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:09.287912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.290069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.296018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.296457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.297233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.297664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.326231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-be65fe80-b9c1-4c66-b177-6a0a662a2e40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Aug 02 09:18:09.326776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 536/1069] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:09.765969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.766589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.773367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.773823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.774595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.775034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.937082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:09.945097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e32b8f8a-ad7a-4c40-ab16-d2888193201b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.183079 Aug 02 09:18:09.945677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 534/1070] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:10.218398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.220530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.227170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.227623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.228397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.228837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.250211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.250899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.258460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.258910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.259681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.260119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.260469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd951dad-728f-4acf-aca3-89834b2fcb45 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Aug 02 09:18:10.261066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 537/1071] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:10.271838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.274053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.279976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.280424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.281267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.281651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.300901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:10.315970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5773459-8e1c-4d57-a2b1-9e7f4e2e4260 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047957 Aug 02 09:18:10.316553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 538/1072] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:10.328842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:10.336627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-255b1a60-a9da-41a4-a35c-93e41359dea8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090456 Aug 02 09:18:10.337355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 535/1073] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:10.339043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.341241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.347831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.348283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.349069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.349528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.378975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fc0abe3c-b48d-4b2f-8acd-3a1bf7b00e91 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043932 Aug 02 09:18:10.379535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 539/1074] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:10.968500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.969266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.976395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.976845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.977647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.978081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.111801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:11.119498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94a2a89e-d417-48a8-9562-5575f6c50767 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155428 Aug 02 09:18:11.120059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 536/1075] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:11.272003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.274207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.280709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.281185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.281957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.282392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.312440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-360f75b6-241c-41c6-82a7-b22c890af44e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Aug 02 09:18:11.312987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 540/1076] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:11.328160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.330494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.336889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.337373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.338142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.338732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.359122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.359738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.366392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.366842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.367614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.368050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.371141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b3578f55-37a2-4faf-bd3a-d610b4599a96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047239 Aug 02 09:18:11.371890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 537/1077] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:11.391393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.393841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.399830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.400282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.401079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.401547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.430675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:11.433025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4b96907-214e-4274-92f3-fa0fa787e9fe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045616 Aug 02 09:18:11.433758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 538/1078] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:11.438440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ee2f00c0-6ee2-49ea-b154-dd327924a13e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084474 Aug 02 09:18:11.438995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 541/1079] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:12.141002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.141570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.148407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.148863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.149711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.150157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.287334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:12.295031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a18a1ebc-85b4-4ecd-b267-33393054d278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157966 Aug 02 09:18:12.295604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 539/1080] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:12.324393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.326539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.333405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.333837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.334815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.335000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.365054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3129234-bd0f-4ada-87c3-269d8f5f82d9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Aug 02 09:18:12.365701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 542/1081] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:12.384712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.387842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.394040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.394402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.395183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.395628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.433844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a378f13-291e-4896-9e6b-23f22ce7db5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053102 Aug 02 09:18:12.434423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 540/1082] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:12.446807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.448994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.456713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.457200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.457995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.458433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.459923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.460580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.466862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.467322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.468110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.468555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.490070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c7d58d0a-2f51-44ab-829a-733e5de64fd9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047251 Aug 02 09:18:12.490724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 543/1083] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:12.536703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:12.544691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5f6cff06-4bbd-49de-9bcf-3502023e1691 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089584 Aug 02 09:18:12.545304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 541/1084] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:13.316702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.317343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.323508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.323953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.324742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.325309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.379553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.381855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.387923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.388549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.389132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.389589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.425365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98aeaf40-e58d-458a-88c8-ff01ff430929 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050546 Aug 02 09:18:13.425946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 542/1085] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:13.446516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.448707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.454762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.455302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.456084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.456524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.460952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:13.468491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5f0bf1e-c899-4dad-83b8-038a140df08a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156434 Aug 02 09:18:13.469064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 544/1086] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:13.486910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-23b81a2b-1b60-416c-b163-485bfffd5b83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Aug 02 09:18:13.487451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 543/1087] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:13.502398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.506099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.512056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.512504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.513312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.513750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.544680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11da65c8-9ed2-4970-bedc-2d15084c013f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046291 Aug 02 09:18:13.545272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 545/1088] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:13.565529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.566151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.572253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.572656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.573447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.573889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.635979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:13.644003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9a357ad1-9658-4fe0-ac1b-83c18d9bd200 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082722 Aug 02 09:18:13.644571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 544/1089] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:14.437719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.439970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.446423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.446868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.447637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.448069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.476539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c7ace5d3-c34f-4e24-959f-66bb9262f152 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Aug 02 09:18:14.477097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 546/1090] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:14.490441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.491059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.497802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.498339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.498735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.499115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.499555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.500866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.507165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.507610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.508376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.508810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.540414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-faaca7aa-68d7-4bd0-b5b0-ba74e08284ab tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Aug 02 09:18:14.541224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 547/1091] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:14.557579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.559750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.566138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.566586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.567351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.567816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.597590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4d8fb2c8-6cac-4496-a561-daab84c74925 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043947 Aug 02 09:18:14.598162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 548/1092] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:14.633304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:14.635492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:14.642080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5f96d0f4-6a92-4248-be62-91b8d8ebef4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156326 Aug 02 09:18:14.643459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 545/1093] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:14.664463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.665078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.671170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.671618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.672406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.672825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.734825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:14.743071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f1db08aa-caab-4b67-93a8-84ad84ec072a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082363 Aug 02 09:18:14.743678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 549/1094] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:15.489352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.491544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.498164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.498617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.499375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.499810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.529605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b9adddee-5e57-4d67-8dde-0a1cc057c2e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Aug 02 09:18:15.530164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 546/1095] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:15.552544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.554789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.561279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.561732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.562497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.562936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.591984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33d82ae9-6b2b-43ba-b431-67dbd33b37da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Aug 02 09:18:15.592531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 550/1096] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:15.609672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.611908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.617901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.618351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.619114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.619554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.649681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b72434b-b279-4673-bba6-1109f6974c3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043963 Aug 02 09:18:15.650234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 547/1097] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:15.664191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.664804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.670759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.671211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.672038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.672441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.763791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.764496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.771135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.771677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.772508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.773005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.802006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:15.809677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-59fb6774-b0bf-48bd-86af-e22ee57b3e60 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.149319 Aug 02 09:18:15.810447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 551/1098] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:15.834926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:15.842436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7df47f4d-463b-4d77-a6fd-499bd984e618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082528 Aug 02 09:18:15.842996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 548/1099] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:16.543221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.545550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.552918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.553587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.554302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.554725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.584340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2dabb3a9-3779-4d7f-be45-ebeccc094e13 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Aug 02 09:18:16.584905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 552/1100] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:16.603848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.605946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.612824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.613304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.614062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.614489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.645524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fa163ca-e202-4398-be3d-bac1cf7b1644 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Aug 02 09:18:16.646522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 549/1101] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:16.663491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.665687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.672582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.674171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.675097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.675548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.701483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-45197a1f-2f56-4db5-9fb3-e7251616f8e4 req-cf84277d-c11e-4a3c-85dd-3a6cd847638c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64272d61-0647-41fa-960d-d71df9c72c70", "name": "network-vif-unplugged", "status": "completed", "tag": "86db858b-f033-44df-ba65-35bb43a0e045"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:16.710493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21a0830e-828d-4813-98ff-e1934982e49c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051459 Aug 02 09:18:16.711402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 550/1102] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:16.717417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-45197a1f-2f56-4db5-9fb3-e7251616f8e4 req-cf84277d-c11e-4a3c-85dd-3a6cd847638c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.717870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-45197a1f-2f56-4db5-9fb3-e7251616f8e4 req-cf84277d-c11e-4a3c-85dd-3a6cd847638c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.730347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-45197a1f-2f56-4db5-9fb3-e7251616f8e4 req-cf84277d-c11e-4a3c-85dd-3a6cd847638c service nova] Creating event network-vif-unplugged:86db858b-f033-44df-ba65-35bb43a0e045 for instance 64272d61-0647-41fa-960d-d71df9c72c70 on hv-cinder-80382 Aug 02 09:18:16.735606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-45197a1f-2f56-4db5-9fb3-e7251616f8e4 req-cf84277d-c11e-4a3c-85dd-3a6cd847638c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101441 Aug 02 09:18:16.737322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 553/1103] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:16.832433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.833048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.839127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.839577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.840336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.840777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.862783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.863486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.869709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.870155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.870924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.871357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.940226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:16.947952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f073734b-df15-4172-8082-f87f9d26235c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089523 Aug 02 09:18:16.948465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 554/1104] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:16.978347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:16.985879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79c7601b-fa3e-43bf-9cb5-b8238731d2e3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158391 Aug 02 09:18:16.986836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 551/1105] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:17.596835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.599692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.606490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.606945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.607720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.608163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.632694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:17.638227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41eef7a1-e1a3-4024-9688-972baeb581f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Aug 02 09:18:17.638784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 555/1106] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:17.658742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.661647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.668053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.668504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.669311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.669752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.698345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3730619e-96a6-4f36-ab18-70f95fa335f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Aug 02 09:18:17.698891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 552/1107] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:17.724340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.726543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.732458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.732983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.733707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.734140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.763415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3529904-21e4-43ea-9f31-f728c3be9792 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044311 Aug 02 09:18:17.763969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 556/1108] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:17.969029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.969783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.975825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.976278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.977043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.977508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.008060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:18.008669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:18.014666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.015110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.015872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.016304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.039371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:18.047172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a5d9141c-2f4c-4379-8ef1-af3d76f73234 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081943 Aug 02 09:18:18.055236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 553/1109] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:18.147986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:18.155439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2abece2a-0699-46b3-9cb3-f640d7ee2602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151220 Aug 02 09:18:18.156004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 557/1110] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:18.650582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:18.652738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:18.658881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.660096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.660556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.660988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.690299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c92599bb-b721-463e-8b94-77d673c9fa49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Aug 02 09:18:18.690890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 554/1111] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:18.710641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:18.712983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:18.719962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.720416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.721201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.722220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.759898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-27a0ff88-9884-40dc-b21c-b2341886ad37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053245 Aug 02 09:18:18.760478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 558/1112] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:18.775628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:18.777928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:18.783908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.784879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.785820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.786265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.815090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3323da7b-b3c4-415f-aca9-b2b84980bef6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043427 Aug 02 09:18:18.815679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 555/1113] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:19.067135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.067747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.073793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.074243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.075000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.075436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.135695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:19.143129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a4a04cab-6aab-44d9-b51b-11da536a97d9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.079930 Aug 02 09:18:19.144265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 559/1114] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:19.176761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.177360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.183303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.183742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.184492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.184921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.317508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:19.324970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d0112f73-aec8-449b-988c-2730c984575f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152403 Aug 02 09:18:19.325651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 556/1115] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:19.702223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.704421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.711430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.712029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.712653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.713093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.742748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-37c15a8f-4839-421b-970a-790b768797e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 02 09:18:19.743317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 560/1116] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:19.772791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.775145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.781508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.781952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.782709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.783167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.812756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a55f7f76-4e9c-43bb-931b-444ec624019f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 02 09:18:19.813323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 557/1117] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:19.826547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.828680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.834923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.835377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.836144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.836585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.865760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bba148c2-63bc-46da-95a3-6f4e92befe79 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043205 Aug 02 09:18:19.866317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 561/1118] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:20.164686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.165331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.171216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.171656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.172407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.172846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.233803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:20.242752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81b6cdde-fea0-4032-86ad-991a605bcc75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082023 Aug 02 09:18:20.243341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 558/1119] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:20.347143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.347811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.353884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.354339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.355102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.355540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.490389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:20.497759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c627dc7f-69d5-4612-aaa1-744dc4b7a22e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155121 Aug 02 09:18:20.498320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 562/1120] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:20.755520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.757717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.763708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.764155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.764917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.765399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.795571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc15ddea-3479-41fc-abd6-7b1d08138e14 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Aug 02 09:18:20.796265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 559/1121] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:20.826202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.828454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.835596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.836049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.836847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.837322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.866343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-13835ed5-386f-48a8-aab8-bcd31382afc6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Aug 02 09:18:20.866905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 563/1122] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:20.878869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.880976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.886911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.887362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.888125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.888558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.918859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e9980515-173a-411f-8769-c8ec1061ab58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044713 Aug 02 09:18:20.919413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 560/1123] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:21.263831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.264449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.271129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.271577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.272331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.272768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.333325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.340748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c61a625f-03f8-4637-9424-9e7ab8676ea9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080834 Aug 02 09:18:21.341486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 564/1124] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:21.518742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.519352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.525359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.525805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.526557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.526984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.660928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.668644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff614938-9e44-4de4-80c1-c0b5c158f03e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153864 Aug 02 09:18:21.669220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 561/1125] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:21.808036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.810237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.816564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.817018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.817834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.818254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.847353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8555e37e-ba2f-4725-a3c8-795a09ca1b2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 Aug 02 09:18:21.848105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 565/1126] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:21.878860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.881045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.887437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.887887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.888656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.889090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.902753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:21.919299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0561920e-af11-4f32-9ecb-582503b19a64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Aug 02 09:18:21.919872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 562/1127] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:21.931867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.934067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.940188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.940660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.941469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.941909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.970123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-764145b4-425e-4995-8560-f14fee86c50c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042255 Aug 02 09:18:21.970672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 566/1128] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:22.363099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.363711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.369710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.370156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.370903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.371330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.431859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:22.439355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fa84387-3aa7-455c-b735-bdc53f5f8fc9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080298 Aug 02 09:18:22.439923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 563/1129] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:22.691918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.692460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.698561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.699018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.699786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.700226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.833275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:22.841250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-89bed4c7-add3-452d-a9a1-59aec6112857 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154016 Aug 02 09:18:22.841821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 567/1130] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:22.859478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.861957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.869035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.869524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.870306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.870745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.900542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed61fd1a-9295-486e-a533-47090bdd3244 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Aug 02 09:18:22.901221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 564/1131] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:22.932048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.934215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.940159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.941303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.942117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.942498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.970862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-58fadc48-3580-4192-8e11-7b163be7b32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Aug 02 09:18:22.971420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 568/1132] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:22.982863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.985086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.992101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.992556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.993361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.993806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.023446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d0ae7e19-bdea-4b0f-ace3-3e3139dab324 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044638 Aug 02 09:18:23.023995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 565/1133] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:23.461005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.461649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:23.467615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.468059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.468812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.469273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.533225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:23.540815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d31b9b3-43d6-439d-b532-1108c1a71ea0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084412 Aug 02 09:18:23.541414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 569/1134] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:23.863371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.863981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:23.870035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.870485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.871286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.871658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.912655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.914890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:23.922199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.922199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.922849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.923273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.953753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-101e5fe9-63f3-4919-a633-e285013c8572 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Aug 02 09:18:23.955876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 570/1135] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:23.983396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.985593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:23.991804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.992255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.993027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.993492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.009440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:24.017133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b54db3eb-1957-4c25-8208-bdd9262711d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158181 Aug 02 09:18:24.017684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 566/1136] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:24.024182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a1bf09ab-560e-4449-b798-d6f75ac91a06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Aug 02 09:18:24.024752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 571/1137] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:24.034717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.036844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.042714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.043161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.043913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.044347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.072671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cb9796c9-437e-4b87-8486-f48106ed5598 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041895 Aug 02 09:18:24.073249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 567/1138] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:24.561592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.562208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.568850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.569328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.570091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.570600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.588428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:24.632746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:24.640261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-20610b4d-f840-491b-a83f-c8f9dd4fa890 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082561 Aug 02 09:18:24.640827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 572/1139] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:24 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:24.966133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.968370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.975576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.976017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.976770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.977222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.007762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eeb5b354-ee2a-4e36-85bd-56ae50c7e87e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Aug 02 09:18:25.008315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 568/1140] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:25.036585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.038799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.040052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.040667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.045687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.046155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.046669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.046978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.047133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.047409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.047899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.048339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.076766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54a01279-c912-4650-a0e5-10f79dd4a375 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Aug 02 09:18:25.077548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 573/1141] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:25.086762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.088922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.101693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.102146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.102938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.103373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.133934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c07289d0-18fb-42a2-8f1c-edcd4d2de5df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050900 Aug 02 09:18:25.134505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 574/1142] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:25.181543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:25.189281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-52cb8d80-6954-4cc2-8f6c-8588c195a0eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152872 Aug 02 09:18:25.189869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 569/1143] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:25.660560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.661187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.667171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.667614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.668364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.668792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.729056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:25.736603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60cf3c05-128d-49fc-9114-e660507fe33e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080169 Aug 02 09:18:25.737320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 575/1144] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:26.020052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.022234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.028659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.029134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.029911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.030355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.059315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e720896c-eed4-44d8-903c-b78ffe33dde8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Aug 02 09:18:26.059932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 570/1145] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:26.089540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.091719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.098218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.098670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.099442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.099881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.129754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8371713-48d9-4fd1-b472-598d6475b2b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 02 09:18:26.130313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 576/1146] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:26.146226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.148548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.154487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.154933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.155682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.156112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.185415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-569fe70b-fc28-4c60-aafa-781d7ede30cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043174 Aug 02 09:18:26.185884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 571/1147] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:26.210609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.211229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.217269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.217719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.218489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.218928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.350769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:26.358431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b7e5b40-4102-49b1-90e1-6c9e90bea064 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151710 Aug 02 09:18:26.359004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 577/1148] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:26.756846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.757500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.763737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.764219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.764990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.765469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.830229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:26.838451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-00cebc95-2853-4e3b-8cd7-f8584cf98b5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085803 Aug 02 09:18:26.839017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 572/1149] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:27.072298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:27.074490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:27.081228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.081831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.082607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.083047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.111182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ea058831-ea57-4851-9282-8e1de3899db9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042869 Aug 02 09:18:27.111971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 578/1150] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:27.141899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:27.144760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:27.151210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.151659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.152424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.152863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.181544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79f851bf-4760-4f3f-b6eb-04d544df0982 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Aug 02 09:18:27.182117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 573/1151] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:27.197914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:27.200176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:27.207260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.207705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.208466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.208901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.236712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0eaf63c-2840-4624-bd21-8caba43723a7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042893 Aug 02 09:18:27.237332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 579/1152] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:27.380733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:27.381304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:27.387233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.387683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.388449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.388889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.517234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:27.525421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87e764f6-8860-4024-a6c5-97461eafa3fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.149570 Aug 02 09:18:27.525993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 574/1153] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:27.860052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:27.860677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:27.866952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.867404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.868175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:27.869626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.935826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:27.944416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c1a360c5-0d59-45ad-8571-e9c430637647 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088517 Aug 02 09:18:27.944986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 580/1154] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:28.123583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.125742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.132763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.133273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.134041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.134473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.163270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d303cdb0-222d-4b41-906d-0c8f984394e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Aug 02 09:18:28.163919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 575/1155] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:28.194448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.196582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.202563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.203003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.203758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.204210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.232938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a00e6be1-c661-4e28-9fab-0c3f4a8476fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Aug 02 09:18:28.233513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 581/1156] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:28.248993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.251156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.253864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:28.259086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.259539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.260311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.260750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.289429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7419b1b4-1569-49ec-b34e-99786680211a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044290 Aug 02 09:18:28.289987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 576/1157] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:28.547459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.548082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.554718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.555170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.555933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.556375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.685095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:28.692761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1fa8d8c8-cf89-433c-a160-09470ec81be4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.149176 Aug 02 09:18:28.693368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 582/1158] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:28.964842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.965540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.972297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.972752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.973546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.973986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.034843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:29.042332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5eecddbf-8dbd-40cb-8477-139399fefccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081356 Aug 02 09:18:29.042895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 577/1159] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:29.175753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.177884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.184037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.184486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.185367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.185806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.215928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c5ab1258-5454-4fbf-906c-edef7288a3dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Aug 02 09:18:29.216547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 583/1160] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:29.245856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.248000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.255577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.256030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.256803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.257275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.286574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9e090215-3447-428f-9997-16b10e3facb4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Aug 02 09:18:29.287128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 578/1161] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:29.301732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.303907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.305766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:29.311146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.311592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.312356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.312792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.342874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3c286f14-f1e5-49b7-b33d-8ec15fc298e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045339 Aug 02 09:18:29.343429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 584/1162] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:29.714388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.715045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.722284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.722733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.723496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.723930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.726562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:29.855719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:29.863349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aacc3d0b-d7e7-48e8-a22d-4ca51f420f55 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153033 Aug 02 09:18:29.863910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 579/1163] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:30.063311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.063930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.070566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.071018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.071784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.072231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.136107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:30.144216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54e10d02-c4f2-4305-aefd-82cd9b01400a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084840 Aug 02 09:18:30.144774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 585/1164] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:30.227767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.230030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.236058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.236509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.237379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.237819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.266868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8436e778-294a-482e-a827-99106739b192 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Aug 02 09:18:30.267510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 580/1165] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:30.298406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.301235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.307703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.308139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.308892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.309352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.338077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-301d2ee4-7a2c-463d-b04b-be9df94efe48 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Aug 02 09:18:30.338553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 586/1166] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:30.355431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.357595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.364661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.365130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.365893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.366331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.396596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bea1cb62-3b41-4edc-b3de-f4642d68c9a4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045079 Aug 02 09:18:30.397228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 581/1167] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:30.884291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.884911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.890966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.891422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.892191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.892633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.026607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:31.034753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b6901166-b6de-43ea-b6f9-b3d268194bf5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154375 Aug 02 09:18:31.035319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 587/1168] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:31.165513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.166054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:31.172153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.172609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.173435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.173877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.234814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:31.242741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fed12a49-1ea8-4171-b9d1-9033fe3aa9a7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081280 Aug 02 09:18:31.243301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 582/1169] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:31.279678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.281922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:31.288795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.289271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.290023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.290449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.318717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-041dee26-f50a-4354-aef4-c17a4dcb46da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042947 Aug 02 09:18:31.319358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 588/1170] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:31.350745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.352966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:31.359080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.359530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.360301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.360737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.391407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c449b674-1666-412b-afca-73bfa888e1a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Aug 02 09:18:31.391957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 583/1171] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:31.408073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.410892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:31.416964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.417411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.418164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.418597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.422182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:31.447905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e8ed9cf-267c-464a-ae91-f3f0d48c76d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043944 Aug 02 09:18:31.448456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 589/1172] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:32.055934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.056550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:32.062703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.063161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.063927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.064368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.191732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:32.199212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8dc1b40d-cb66-44f0-b8a5-632da1c121be tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.147244 Aug 02 09:18:32.199782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 584/1173] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:32.263738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.264386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:32.271153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.271607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.272375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.272814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.331760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.333314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:32.333925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:32.339808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.340248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.340873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-67a44716-1749-4e97-bd9f-7ce75fa76c75 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081091 Aug 02 09:18:32.341016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.341475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 590/1174] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:32 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:32.341579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.370051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1875dc5e-3cc6-4a07-b55b-f2d552cea516 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043059 Aug 02 09:18:32.370648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 585/1175] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:32.403617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.405700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:32.411706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.412148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.412901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.413353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.441644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72ef0a2e-b8d1-4304-a473-9a9fe7214c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Aug 02 09:18:32.442185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 591/1176] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:32.461449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.463618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:32.469601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.470050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.470815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:32.472195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:32.500570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3f8ee3b6-37ce-4776-94ea-5f702f0d015d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043107 Aug 02 09:18:32.501145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 586/1177] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:33.221632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.222171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.228225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.228680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.229484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.229924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.361229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:33.361891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.362449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.368859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dabd6049-e628-4c52-be8c-b89092705f3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151800 Aug 02 09:18:33.369040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.369382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.369783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 592/1178] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:33.370147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.370617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.382228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.384368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.390258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.390707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.391461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.391890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.422498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e59451b-35b2-421e-936f-7f3551c18662 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Aug 02 09:18:33.423144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 593/1179] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:33.437195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:33.444767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7331bb6d-0b31-44c1-b536-58befb3434fd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086714 Aug 02 09:18:33.445351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 587/1180] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:33.453608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.456371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.462443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.462885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.463637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.464066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.492583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0b1ff026-d4ae-46c5-ba7c-36903650aa94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Aug 02 09:18:33.493059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 594/1181] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:33.513814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.516003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.522778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.523210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.523974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.524410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.553607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ba9aed71-30e2-453a-b394-0f0b10ec8e8c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043822 Aug 02 09:18:33.554156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 588/1182] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:34.390747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.391352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.398452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.398900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.399659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.400100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.434912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.437307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.444557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.445008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.445808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.446277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.475963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d10a2a0-d618-4e15-8343-0bcdaaf1914c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Aug 02 09:18:34.476527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 589/1183] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:34.481315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.481921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.487711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.488159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.488926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.489511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.531936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:34.540473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21b8242e-e755-4fbe-9c35-1ed3c9faa680 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153597 Aug 02 09:18:34.541052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 595/1184] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:34.545702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.547870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.552246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:34.554938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.555403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.556184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.556622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.559832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7f4f70bc-c086-47c1-b493-f4d6cb3db1ac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082359 Aug 02 09:18:34.561104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 590/1185] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:34.566574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.568766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.574838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.575292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.576066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.576506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.586715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01c2ea52-93a5-4667-a4ef-4ce576293500 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Aug 02 09:18:34.587301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 596/1186] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:34.606885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f448500b-a8a8-4aa4-ade8-2352595e4c7c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044429 Aug 02 09:18:34.607428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 591/1187] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:35.488155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:35.490364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:35.496818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.497303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.498069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.498505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.527830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f58d80bc-e341-4249-ba56-2b83beea283d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Aug 02 09:18:35.528375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 597/1188] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:35.562380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:35.563025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:35.570259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.570712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.571474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.571911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.581104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:35.581764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:35.587966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.588423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.589290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.589807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.653304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:35.661085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-372b1ddb-6715-4cf3-b678-a30dac3ca775 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084040 Aug 02 09:18:35.661682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 598/1189] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:35 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:35.666319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:35.668518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:35.675889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.676341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.677195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.677590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.706943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:35.707189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2bd58750-4fbd-44b7-bb96-87aff923f881 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Aug 02 09:18:35.707782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 599/1190] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:35.712579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:35.714736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:35.714864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17f0146e-d6d7-4184-8730-534c62d41677 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156419 Aug 02 09:18:35.715481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 592/1191] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:35.720604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.721231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.722016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:35.722484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.751585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dd055bf-e019-4504-b22f-e885d248a31a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042720 Aug 02 09:18:35.752125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 600/1192] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:36.540589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.542758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.548831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.550281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.550281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.550505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.582019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3f213396-db78-47f7-aa42-8725a3c12db3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Aug 02 09:18:36.582708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 593/1193] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:36.682092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.682704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.689310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.690428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.691375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.691812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.719365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.721609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.727665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.728116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.728891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.729361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.757078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:36.760887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8ee57726-971a-44b5-be6f-220e19520b0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Aug 02 09:18:36.761496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 594/1194] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:36.764680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe541f78-ef38-487a-86f1-38606b679c35 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086465 Aug 02 09:18:36.777134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 601/1195] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:36.777354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.777354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.777560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.777560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.777760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.777760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.777760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.777760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.780795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.781277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.782564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.783000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.811636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d2900475-1276-4411-a449-c1c5b39a169d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045261 Aug 02 09:18:36.812159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 602/1196] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:36.909595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:36.911750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:36.918372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-993c6e1f-d7e6-4d60-b679-a088384485f1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155879 Aug 02 09:18:36.919158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 595/1197] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:37.594442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:37.597271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:37.603360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.603815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.604587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.605025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.634979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-37076ec4-5e10-42bd-8d6e-1d859a58e7e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 02 09:18:37.635548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 603/1198] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:37.773772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:37.775938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:37.782819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.783915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.784806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.785280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.787596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:37.788211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:37.794590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.795038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.795801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.796233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.814617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9701131c-84b8-497a-bf0d-b0dd88de137a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 02 09:18:37.815250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 596/1199] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:37.824113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:37.826340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:37.833357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.833812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.834586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.835088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.857828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:37.866124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b0ac3b97-8f7c-416a-a311-3c2d974ae304 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082958 Aug 02 09:18:37.866553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8b8da46e-e0e3-43c3-86c8-7795e23f5886 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046273 Aug 02 09:18:37.866974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 604/1200] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:37 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:37.868598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 597/1201] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:37.940928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:37.941588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:37.947859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.948317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:37.949129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:37.949573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.079206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:38.083138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:38.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5e7e35b7-4dd0-4c74-abef-ad2335a8cf0f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151810 Aug 02 09:18:38.088336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 605/1202] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:38.647418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:38.649600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:38.655545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.655984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.656746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.657204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.686671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8ce23472-5cc9-43eb-b5fe-aa2462f46f32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Aug 02 09:18:38.687214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 598/1203] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:38.827345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:38.829567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:38.836280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.836734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.837529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.837971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.866859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f02a0f52-6179-499d-92bf-e97b8d5eb3c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Aug 02 09:18:38.867417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 606/1204] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:38.879481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:38.881755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:38.888774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.889236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.890096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.890749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:38.890892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.891538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:38.899025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.899424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.900213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.900654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.930272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fa5d7bd6-9cb9-4343-9885-6677b1d9a522 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055401 Aug 02 09:18:38.930840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 599/1205] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:38.966242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:38.974806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8144ae9-cb9d-4f92-84c5-576769d0ec3f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091294 Aug 02 09:18:38.975378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 607/1206] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:38 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:39.109598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.110204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:39.116824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.117302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.118058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.118495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.248412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:39.256161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e3a1a0b2-5bf6-4537-9156-1cd14f6d1adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.150466 Aug 02 09:18:39.256727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 600/1207] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:39.699570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.701786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:39.708636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.709087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.709891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.710331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.738923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-50c5aaea-ec48-4f6d-9d48-8f641b073aa3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Aug 02 09:18:39.739476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 608/1208] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:39.880397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.882567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:39.888931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.889408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.890165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.890595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.919836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3e165bfd-df45-40cf-8431-48889e20d9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Aug 02 09:18:39.920401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 601/1209] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:39.943253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.945454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:39.952317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.952698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.953508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.953937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.983010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-232e5583-5e6b-48cb-ae57-cfff939715c7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044406 Aug 02 09:18:39.983556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 609/1210] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:39.995662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.996344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:40.003616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.004072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.004853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.005387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.067688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:40.075090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf0b58ae-4b11-4b66-bafd-506f154b5950 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083284 Aug 02 09:18:40.075646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 602/1211] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:40.278315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:40.278931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:40.286060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.286507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.287268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.287704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.418472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:40.426234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3aab42a7-8141-44c9-b2f2-3fd8083746a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151847 Aug 02 09:18:40.426799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 610/1212] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:40.751307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:40.754245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:40.760207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.760664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.761467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.761911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.790968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8f491486-1ac7-4a03-8640-8af7069ed124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 02 09:18:40.791522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 603/1213] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:40.932453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:40.934699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:40.942669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.943121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.944003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:40.944607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.973767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe17bf98-8556-4523-861b-d649722b6cf7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Aug 02 09:18:40.974330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 611/1214] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:40.995996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:40.998295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.005502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.005960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.006722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.007157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.036168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-38f0ba1c-2f85-47ad-a974-7e83e9a08dce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044804 Aug 02 09:18:41.036715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 604/1215] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:41.098189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.098809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.105134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.105612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.106381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.106821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.168422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:41.176088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5f48c5dc-9171-4297-8a64-752f2ee2a7a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084486 Aug 02 09:18:41.176662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 612/1216] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:41 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:41.447730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.448263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.454286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.454733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.456242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.456680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.587814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:41.595207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-208efe35-a49c-43cb-89b4-153d3beefbb4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151507 Aug 02 09:18:41.596052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 605/1217] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:41.803209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.805395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.811471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.811908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.812662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.813090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.842211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3416e038-8d26-4532-8553-a1a67f0905c3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 Aug 02 09:18:41.842762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 613/1218] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:41.986830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.989068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.995065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.995514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.996280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.996811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.025415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4cfe58cf-cd1d-4297-b2dd-c84e7b1e911c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Aug 02 09:18:42.025964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 606/1219] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:42.047893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.050915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.057459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.057865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.058635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.059074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.087505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e9863d17-f9b2-498b-951d-0fb5ffe4ce84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043618 Aug 02 09:18:42.088067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 614/1220] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:42.240096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.240713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.246625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.247085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.247847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.248286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.308926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:42.316370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-632903ec-6f8f-42b3-882c-6d94c5552385 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.124378 Aug 02 09:18:42.316938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 607/1221] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:42.661402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.662025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.667993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.668440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.669234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.669672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.806347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:42.814083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-08b13d70-313a-4b67-b858-a06df105c0dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.200847 Aug 02 09:18:42.814698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 615/1222] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:42.854620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.856902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.863526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.863976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.864715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.865173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.893538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c09b4f00-8661-47e4-8e20-0fba9a02567f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042807 Aug 02 09:18:42.894017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 608/1223] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:43.037835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:43.040072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:43.046063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.046509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.047264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.047698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.078332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aac42e1c-c3b5-4188-9b6e-73537f917a1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 02 09:18:43.079005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 616/1224] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:43.100528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:43.102860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:43.109261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.109718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.110485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.110925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.139394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95a0d850-ad89-40eb-a25c-bf58f3e323d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043528 Aug 02 09:18:43.139939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 609/1225] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:43.336944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:43.337598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:43.343632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.344085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.344852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.345319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.407052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:43.414662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2d40ff3a-9a12-4c81-9c32-e2f90af3b92e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081643 Aug 02 09:18:43.415226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 617/1226] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:43 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:43.835937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:43.836553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:43.842599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.843046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.843803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.844241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.906147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:43.908791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:43.914966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.915421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.916204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:43.916682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.948625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f55ab037-cad1-41aa-98b0-b0e9fbb2d5ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Aug 02 09:18:43.949219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 618/1227] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:43.980693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:43.988300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-64e61f80-204b-470b-811c-a7e4643cc1eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156315 Aug 02 09:18:43.988948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 610/1228] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:44.091314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:44.093417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:44.101052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.101534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.102305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.102737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.132646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-03617265-cd0f-4cf6-9962-5bf9902b9bc2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Aug 02 09:18:44.133229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 619/1229] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:44.151828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:44.154146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:44.160556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.161002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.161795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.162233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.190913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-481e54be-1828-4611-b00e-bc90993ad9e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043019 Aug 02 09:18:44.191461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 611/1230] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:44.434933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:44.435477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:44.442048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.442502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.443271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.443711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.503942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:44.511562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bc3717e5-b189-4957-93de-3098323582e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080646 Aug 02 09:18:44.512129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 620/1231] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:44.961472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:44.963702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:44.974669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.975474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.976853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.977713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.993605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:45.008846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.009325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7ca82dc5-0689-470b-ac3a-c33d0a5dd590 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051943 Aug 02 09:18:45.009489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:45.009888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 612/1232] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:45.015550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.015996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.016762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.017236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.144102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.146835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:45.146985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:45.153630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.154085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.154584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-88561ca3-4ab2-40cd-9df6-e2414b5527e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.149590 Aug 02 09:18:45.154845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.155158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 621/1233] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:45.155295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.186064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf9b2ae5-e379-499f-ae4d-ddc9070e7844 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Aug 02 09:18:45.186546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 613/1234] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:45.203169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.205563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:45.211605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.212061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.212838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.213310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.230513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:45.244346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-719924c1-658a-44f6-8a82-2fcc08951e3e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045204 Aug 02 09:18:45.244898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 622/1235] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:45.532798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.534115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:45.540060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.540518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.541326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.541765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.605987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:45.613461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8e45f2df-408c-4d4f-b61b-c21e8be8f2be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084569 Aug 02 09:18:45.614030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 614/1236] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:46.022249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.024447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:46.030592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.031044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.031812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.032250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.060923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5182592c-7333-41f2-b64b-3b99cb3e6083 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Aug 02 09:18:46.061510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 623/1237] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:46.177485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.178035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:46.184377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.184827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.185613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.186052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.198279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.200433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:46.207456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.207905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.208674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.209311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.240135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe5a0568-d3d4-4728-b75d-5b4a364e4824 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Aug 02 09:18:46.240714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 624/1238] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:46.257231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.259372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:46.265297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.265849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.266504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.266937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.296415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a87f4539-1354-4d50-ad09-520fc2994908 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044537 Aug 02 09:18:46.297223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 625/1239] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:46.319785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:46.327332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-18f21d6a-cf8a-4470-a697-b2f1b92e7dc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154838 Aug 02 09:18:46.327898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 615/1240] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:46.633991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.634618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:46.640580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.641035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.641843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.642439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.706147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:46.713665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c5dcbafa-dc56-4422-a657-023612b54fad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083550 Aug 02 09:18:46.714237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 626/1241] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:47.073276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:47.075451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:47.082065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.082510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.083269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.083697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.112274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f8720fca-e1ad-4429-9827-1916b64beeb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043026 Aug 02 09:18:47.112801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 616/1242] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:47.252909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:47.255158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:47.261664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.262119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.262890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.263329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.293233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9693616d-0128-4eac-8503-241c7a5a8657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Aug 02 09:18:47.293789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 627/1243] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:47.309435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:47.311605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:47.318572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.319016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.319766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.320202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.347848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:47.348468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:47.348879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-080a1dbd-92c6-4921-a4ec-c74531cd74c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043368 Aug 02 09:18:47.349469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 617/1244] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:47.354616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.355072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.355842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.356281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.485735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:47.494220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34794924-c2ee-4cf9-b974-72229f975f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.150320 Aug 02 09:18:47.494844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 628/1245] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:47.734918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:47.735447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:47.741859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.742306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.743060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.743487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.804102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:47.811701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40509c21-e00c-432e-9c2a-6810b26f1642 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080738 Aug 02 09:18:47.812261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 618/1246] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:47 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:48.124521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:48.126819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:48.133409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.133862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.134630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.135071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.164282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8cbd3abf-3d4f-42c5-aa16-f6efb3d6a739 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Aug 02 09:18:48.164846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 629/1247] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:48.305442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:48.307593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:48.313532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.314104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.314733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.315170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.344210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-43199ea8-57b9-4cd0-9480-067df3e5089d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Aug 02 09:18:48.344747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 619/1248] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:48.361166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:48.363290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:48.369650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.370092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.370848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.371278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.399913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5c95c365-bd96-4249-9d3e-bc009721be35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042761 Aug 02 09:18:48.400395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 630/1249] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:48.516059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:48.516669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:48.523129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.523582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.524341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.524777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.655215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:48.663122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87452ce4-2059-4cc1-b4be-160922a73882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.150910 Aug 02 09:18:48.663686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 620/1250] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:48.833379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:48.833999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:48.840030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.840490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.841282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.841722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.905610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:48.913355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54e65902-e8d1-414e-bb86-16569871d1e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084493 Aug 02 09:18:48.913933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 631/1251] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:49.177474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:49.179573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:49.186051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.186537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.187340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.187813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.218903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3049bde7-6e3c-4825-b7aa-f493b59647bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Aug 02 09:18:49.219460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 621/1252] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:49.357026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:49.359225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:49.365381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.365988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.366562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.366988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.397126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-069d65ac-bcd1-43b9-9e54-9864da40c203 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044181 Aug 02 09:18:49.397681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 632/1253] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:49.411952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:49.414120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:49.420466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.420918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.421720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.422163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.450775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3f6f38a2-1c9f-45b5-ab3c-1f53a62daba1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042813 Aug 02 09:18:49.451269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 622/1254] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:49.684603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:49.685246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:49.691976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.692425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.693217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.693657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.832200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:49.839893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6cafc3aa-847e-46d9-929d-de4bc7ba6bac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159262 Aug 02 09:18:49.840463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 633/1255] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:49 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:49.934209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:49.934828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:49.941431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.941885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.942645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.943079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.003658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:50.011071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ce986aea-f434-433d-8f9b-fac1956a7891 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080867 Aug 02 09:18:50.011666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 623/1256] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:50.231512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:50.233609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:50.235483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:50.241703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.242187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.242955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.243390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.272281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f1e6a4bc-75c8-404a-a771-e30ae67f339b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Aug 02 09:18:50.272836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 634/1257] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:50.409126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:50.411285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:50.417685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.418242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.418867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.419292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.448171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-18f79500-85f8-4057-8468-7148ad5d2fcd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Aug 02 09:18:50.448716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 624/1258] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:50.463772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:50.465957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:50.473025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.473490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.474254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.474689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.504672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-71264131-c254-4571-92aa-07daa98f9f7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044854 Aug 02 09:18:50.505259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 635/1259] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:50.864008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:50.864540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:50.876932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.878032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.879129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.879568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.036467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:51.037460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:51.045158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.045628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.046424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.046861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.069752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:51.074471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2d201156-d48c-4db9-8bb3-24f2a27cfa19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.215746 Aug 02 09:18:51.075644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 625/1260] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:51.119722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:51.129003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5dbfa373-10a6-4c7b-a6ea-00fd705c1e78 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.100126 Aug 02 09:18:51.129632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 636/1261] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:51.285056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:51.287271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:51.289859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:51.296262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.296721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.297537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.297982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.333659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1f5ae93-3fa4-472e-b1bc-c9a99b0fa697 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053320 Aug 02 09:18:51.334245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 626/1262] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:51.460574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:51.462860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:51.469808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.470529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.471097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.471537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.506943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81e5ca21-e9ab-4a28-b55a-6b3d0c763206 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050356 Aug 02 09:18:51.507995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 637/1263] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:51.517929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:51.520158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:51.527446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.527900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.528689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.529144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.561868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-76c45cd8-e1f1-4bc7-869b-bae72e5a10c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048340 Aug 02 09:18:51.562436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 627/1264] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:52.100184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.100813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:52.107016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.107470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.108247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.108690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.154752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.155288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:52.161602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.162061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.162837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.163279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.239090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:52.246725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a4078875-aa1b-4a17-b071-e23e8590af6d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.095890 Aug 02 09:18:52.247302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 628/1265] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:52.250772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:52.261923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e5c9d8f1-8ee3-4628-bf52-ed0e95fb674f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166086 Aug 02 09:18:52.262881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 638/1266] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:52.346916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.349081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:52.355136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.355580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.356342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.356773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.359163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:52.391742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9152f6fe-672c-4d0e-aa5b-629e55665a7e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049573 Aug 02 09:18:52.392794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 629/1267] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:52.521957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.524475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:52.531234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.531677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.533006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.533526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.537494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:52.565147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0fa925d-768d-47b2-bddb-dac071416a02 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047161 Aug 02 09:18:52.565707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 639/1268] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:52.574929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.577144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:52.584387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.584841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.585641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.586078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.617560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2ac64b5a-ad8f-449f-9bf6-c61ee0f6a5ac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046502 Aug 02 09:18:52.618132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 630/1269] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:53.268858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:53.269579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:53.275885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.276337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.277143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.277588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.286023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:53.286638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:53.292977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.293469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.294238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.294701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.346905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:53.355150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d7416c75-ad18-4587-b485-40e2fc5f4c4b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090793 Aug 02 09:18:53.355739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 640/1270] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:53 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:53.403956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:53.406228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:53.412753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.413237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.414020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.414465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.442377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:53.445674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dceba66a-c51e-4ff7-b4e9-82533b23ea72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Aug 02 09:18:53.446269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 641/1271] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:53.453258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5a3b015e-1f66-4f54-a042-16f943278e86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.172118 Aug 02 09:18:53.453862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 631/1272] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:53.577659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:53.579761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:53.586385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.586839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.587617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.588055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.618266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c3796434-a545-4f82-8270-d33586acc44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Aug 02 09:18:53.618839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 642/1273] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:53.631142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:53.633367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:53.639801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.640257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.641026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:53.641491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.670958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c559f09-0f9f-4939-b611-f7f9304a4ae6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044820 Aug 02 09:18:53.671535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 632/1274] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:54.375978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.377574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:54.383940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.384392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.385198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.385642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.452775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:54.457848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.460060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:54.461563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe109804-47de-462c-8e71-ab268fdfac0f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089478 Aug 02 09:18:54.462161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 643/1275] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:54.466366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.469280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.469280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.469280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.480796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.481879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:54.491845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.492572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.493904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.494653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.512238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7c90dd8a-9670-45cf-bd6e-6af43b4ded42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058845 Aug 02 09:18:54.513043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 633/1276] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:54.632695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.634816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:54.635221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:54.641406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.641861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.642646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.643086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.643593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ac5a5b23-19de-4a5b-bc60-fa2ca8e7f3eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169415 Aug 02 09:18:54.644192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 644/1277] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:54.680648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6757467a-8774-48d7-8c7b-2eb481bf2854 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051911 Aug 02 09:18:54.681264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 634/1278] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:54.684390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.686597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:54.692925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.693372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.694161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.694601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.728585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-29032af0-5b7e-4563-b9ff-417348a371cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048175 Aug 02 09:18:54.729196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 645/1279] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:55.485155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:55.485915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:55.492103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.492696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.493708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.494217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.524138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:55.526369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:55.532411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.532873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.533672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.534113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.556532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:55.564339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-521a9703-1878-47db-ae0c-1a214f92d3ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Aug 02 09:18:55.564522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4322c7d4-e68f-4a70-aa58-b68840fb32f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082665 Aug 02 09:18:55.565330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 646/1281] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:55.565472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 635/1281] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:55.665566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:55.666122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:55.672594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.673103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.673917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.674565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.693683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:55.695828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:55.702483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.702928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.703687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.704124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.734490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-19a4f697-47fa-4859-b76d-d0b44bf7cecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Aug 02 09:18:55.735359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 636/1282] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:55.741159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:55.743611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:55.749618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.750068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.750855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.751797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.782014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fa6f61f7-0d5b-4024-8dee-80d826ed4094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044997 Aug 02 09:18:55.783379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 637/1283] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:18:55.809832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:55.818679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4206e49a-a929-4aba-b0c8-77c36dc41640 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156994 Aug 02 09:18:55.819251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 647/1284] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:56.576037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:56.578269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:56.584886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.585371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.585756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:56.586141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.586380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:56.586580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.592535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.592990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.593793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.594238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.616090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f971fe3-fdc5-42af-ad22-278816b06fb2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Aug 02 09:18:56.616700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 638/1285] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:56.655963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:56.664075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9e2508d0-695e-44d6-9def-3a6eee66de4f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082185 Aug 02 09:18:56.664640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 648/1286] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:56.747969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:56.750216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:56.757376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.757828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.758588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.759029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.789067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7159a232-fcd5-4520-9efd-657c0e0197b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Aug 02 09:18:56.789824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 639/1287] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:56.794889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:56.797038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:56.803593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.804039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.804799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.805264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.838681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-43afb098-d65a-4e46-95a9-c76e5bb833f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047667 Aug 02 09:18:56.839261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 649/1288] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:56.839750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:56.840438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:56.847505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.847945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.848705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.849153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.983059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:56.990778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c197ddd5-016f-4a7f-afd1-986233202bee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154908 Aug 02 09:18:56.991345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 640/1289] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:57.630150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.632328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:57.638990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.639440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.640216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.640658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.670796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-764429d3-0dad-461e-aac3-194e9e102b4d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Aug 02 09:18:57.671361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 650/1290] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:57.684599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.685273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:57.691509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.691957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.692721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.693183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.754538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:57.762677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5ca72b72-5d26-43c4-962f-fa43971f38dc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081969 Aug 02 09:18:57.763262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 641/1291] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:57.802224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.804409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:57.810519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.810969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.811741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.812178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.843815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8275f64-2979-4b43-91bf-a6472e9cdfbd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Aug 02 09:18:57.846340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 651/1292] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:57.853102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.855320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:57.862500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.862954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.863730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.864841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.899533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-216ef8f1-1d5c-46be-acd2-ee1d9452c1e2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050419 Aug 02 09:18:57.900134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 642/1293] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:58.012919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.013565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:58.020290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.020742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.021556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.021995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.155615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:58.163993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-983a3ebc-5653-41db-891d-b9882e4d52a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155001 Aug 02 09:18:58.164578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 652/1294] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:58.684533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.686714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:58.693473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.693924 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.694692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.695131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.725156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-816a11bc-0ed4-4647-9d62-f72532efb5c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Aug 02 09:18:58.725731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 643/1295] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:58.783398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.784015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:58.790804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.791276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.792059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.792499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.856144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.858250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:58.858652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:58.865763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.866218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.866691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60a9fbc8-08fd-467c-965e-53190896730a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087296 Aug 02 09:18:58.867001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.867291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 653/1296] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:58.867443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.899462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a8158c80-d31d-4d93-b0e2-1f6d9e7bf405 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 02 09:18:58.900076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 644/1297] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:58.912109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:58.914352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:58.920912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.921423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.922218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:58.922659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.956677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7addf7ab-eb4d-4d65-bb36-5773c530c640 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048098 Aug 02 09:18:58.957629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 654/1298] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:18:59.185338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:59.185968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:59.192061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.192523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.193313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.193789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.327164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:59.329383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:59.335987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bb94c135-db60-46b6-a5ce-28c11664a766 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154649 Aug 02 09:18:59.336549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 645/1299] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:59.737839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:59.739892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:59.746067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.746511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.747267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.747697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.772719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:59.778156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa4a3d32-a198-4106-aaf4-1244e5669eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 02 09:18:59.778721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 655/1300] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:59.887779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:59.888598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:59.895955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.896411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.897215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.897656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.913562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:59.915764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:59.922165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.922652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.923428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.924029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.955373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5918f572-f627-4357-adfb-8db2a194b09c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Aug 02 09:18:59.955960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 656/1301] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:18:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:59.965817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:59.969341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:59.971735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:59.973871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17d06bc9-c561-4ee9-a82c-90f72c31e5d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089992 Aug 02 09:18:59.974446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 646/1302] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:18:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:59.977700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.978156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.978934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.979369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.008745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0f75111-befc-4bca-b7ce-0bd37ea89e6a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043351 Aug 02 09:19:00.009341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 657/1303] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:18:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:00.357487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:00.358024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:00.364641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.365095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.365888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.366331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.494959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:00.503388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e851c72a-bdfe-451e-a1ff-4ab2ab8f4d18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.150019 Aug 02 09:19:00.503954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 647/1304] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:00.791621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:00.793837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:00.801001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.801497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.802262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.802708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.831586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-98d00720-ef15-4f2b-a425-ec0ab5eb92c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Aug 02 09:19:00.832144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 658/1305] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:00.968067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:00.971359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:00.977340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.977789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.978547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.978989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.994963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:00.995552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:01.002551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.003004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.003791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.004231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.010756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bcd28304-c216-4b2a-a5df-cbe1baaa7db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046947 Aug 02 09:19:01.011320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 648/1306] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:01.020926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:01.023240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:01.029249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.029801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.030567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.030997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.061152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-080ebdd9-5e35-4ea4-95f6-5e7190c1b62e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044737 Aug 02 09:19:01.061637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 649/1307] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:01.066451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:01.073955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ed229e75-c881-4338-9787-de33ec9bfe28 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083147 Aug 02 09:19:01.074518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 659/1308] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:00 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:01.523815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:01.524456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:01.530791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.531230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.532529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.532994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.660708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:01.668335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-57ee732f-831a-4b69-bea6-09b90ba84f2d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.148360 Aug 02 09:19:01.668925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 650/1309] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:01.843849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:01.846802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:01.853037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.853552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.854325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.854766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.884439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e00d33b3-7c12-4f82-89a7-4b9c0bde9fc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Aug 02 09:19:01.885001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 660/1310] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:02.024283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:02.026709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:02.033826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.034283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.035094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.035612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.074202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:02.075422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d3ad0b01-c610-46b1-bb82-a2862b38304b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055869 Aug 02 09:19:02.076004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 651/1311] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:02.076370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:02.084345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.084793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.085600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.086030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.096485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:02.097016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:02.103493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.103493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.104828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.104988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.121276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b540cacf-e78d-4912-a62b-217cd73a9b50 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051491 Aug 02 09:19:02.128447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 661/1312] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:02.192454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:02.201356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2870de79-64b3-4688-9aa5-c84d1ecd18f7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.110011 Aug 02 09:19:02.202231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 652/1313] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:02.691214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:02.691753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:02.698176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.698624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.699405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.699843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.845886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:02.853681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f8c559bd-9918-4de3-b028-0b0206d78ce6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.167275 Aug 02 09:19:02.854268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 662/1314] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:02.896568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:02.898938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:02.905818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.906271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.907585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.908051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.938830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-68d2f71f-7b9f-4c6d-837a-714a9a98265c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Aug 02 09:19:02.939404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 653/1315] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:03.089226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:03.091414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:03.098490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.098941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.099717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.100156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.130775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bfdf35a7-e238-405e-94da-cd2aba1fd269 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Aug 02 09:19:03.131139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 663/1316] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:03.136228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:03.138435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:03.144598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.145047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.145843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.146281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.176460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a457623-8b31-4d18-a5b2-5aa288f85312 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044067 Aug 02 09:19:03.177033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 654/1317] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:03.225808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:03.226425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:03.232906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.233399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.234184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.234625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.301445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:03.308964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e401899a-18c4-4cd1-a731-9bb56923f50d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087317 Aug 02 09:19:03.309556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 664/1318] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:03 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:03.876584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:03.877574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:03.883654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.884108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.884887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.885359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.951328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:03.953624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:03.960361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.960813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.961627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:03.962064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.994035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-abea521c-ac45-4c4d-94b7-bd019505af5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046748 Aug 02 09:19:03.994825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 665/1319] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:04.025578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:04.033295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1f9ed96-fb91-4010-94e7-66ceecce4671 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161250 Aug 02 09:19:04.034082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 655/1320] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:04.142827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:04.144905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:04.151548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.151986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.152751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.153202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.183619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd86068b-9e9a-4061-9488-84caf6b71018 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Aug 02 09:19:04.184302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 666/1321] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:04.190524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:04.192802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:04.198857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.199311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.200087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.200526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.230015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-316e120b-ca98-485d-b9b5-d3b8f8aa4ee5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 Aug 02 09:19:04.230581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 656/1322] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:04.329966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:04.330588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:04.336788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.337278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.338055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.338489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.622513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:04.630814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b413bd2-3ad2-44f1-9f75-7fe3307e5de2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.304875 Aug 02 09:19:04.631391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 667/1323] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:05.006744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:05.008919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:05.015308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.015748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.017034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.017513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.048385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e48d1c40-7f36-4fe4-bf8f-fc323f4e81e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Aug 02 09:19:05.048946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 657/1324] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:05.055470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:05.056083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:05.062054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.062495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.063524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.064002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.195393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:05.201931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:05.204179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:05.207397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f57dfbbe-95db-47d8-a8d8-5898f96ab7cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155361 Aug 02 09:19:05.208423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 668/1325] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:05.211365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.211941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.212834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.213484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.242727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:05.244909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:05.245048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2840da80-9377-4cbe-bbfe-6c11168e36fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052370 Aug 02 09:19:05.245592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 658/1326] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:05.251816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.252722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.253533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.253977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.284180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0eb53e5b-d019-4a2e-817d-11200f32c806 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045415 Aug 02 09:19:05.284738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 669/1327] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:05.651911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:05.652559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:05.659252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.659701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.660461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.660899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.722800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:05.730245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-36ff5cd6-abb5-4290-8b56-c6ebdb3b6478 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082253 Aug 02 09:19:05.730806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 659/1328] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:05 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:06.061223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:06.063936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:06.070656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.071102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.071869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.072301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.101470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dd16e77-91a3-48bf-a3cd-ccaf41143530 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Aug 02 09:19:06.102025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 670/1329] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:06.231327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:06.231867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:06.238494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.238941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.239697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.240124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.258459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:06.260669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:06.269100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.269595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.270373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.270813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.306541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-acea4e1d-4ce3-4d55-905a-2888a5b8cb58 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051976 Aug 02 09:19:06.307318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 671/1330] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:06.311942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:06.314990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:06.321496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.321948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.322728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.323158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.341385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:06.354608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d6ef9d61-b801-41b2-a836-980c600fe6b7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046371 Aug 02 09:19:06.355364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 672/1331] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:06.384015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:06.391772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e701ed53-46f0-445d-bc25-cb974c9e0181 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164248 Aug 02 09:19:06.392348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 660/1332] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:06.752095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:06.752759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:06.758889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.759341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.760117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.760560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.822566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:06.830394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7f375711-b874-4af1-a0fd-cbdc2e64c63a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082804 Aug 02 09:19:06.830969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 673/1333] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:07.114904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:07.116981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:07.123072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.123519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.124288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.124721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.155304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0921fee8-bb2c-4b17-b488-ad4d3bcf2447 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Aug 02 09:19:07.155868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 661/1334] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:07.320161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:07.322401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:07.329098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.329571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.330509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.330949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.361000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7abc67cf-3bd9-4e80-944e-3b522e42af32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Aug 02 09:19:07.361612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 674/1335] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:07.367146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:07.369300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:07.376470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.377502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.378278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.378740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.393449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:07.411099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9670ff07-f559-4bc0-8f42-e4f3cc9d8758 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048011 Aug 02 09:19:07.411686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 662/1336] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:07.413522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:07.414148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:07.420309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.420759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.421640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.422116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.560620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:07.568607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb8c8859-20e7-47a5-87fa-aaf97d610478 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159045 Aug 02 09:19:07.569224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 675/1337] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:07.852198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:07.852832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:07.859392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.859900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.860933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.861336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.932966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:07.941639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0537ba78-f264-4e24-87bb-a4ca713dacf0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093261 Aug 02 09:19:07.942248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 663/1338] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:08.168681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:08.170751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:08.177284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.177751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.178544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.178979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.211828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ffb4f927-7149-4cb1-a150-e4b1c0299283 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Aug 02 09:19:08.212414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 676/1339] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:08.373557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:08.376240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:08.383974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.384508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.385449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.385995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.418879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-78fe9327-a0df-4004-a79a-5d1150d105b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049280 Aug 02 09:19:08.419372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 664/1340] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:08.424227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:08.426442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:08.433105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.433580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.434356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.434790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.466874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e03a427f-982b-4118-942a-90ea0e80d998 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046819 Aug 02 09:19:08.467464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 677/1341] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:08.590287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:08.591024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:08.597413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.597862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.598671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.599106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.737635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:08.745733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-640bd89d-938e-49c8-97b6-ca193c5d82e1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159264 Aug 02 09:19:08.746324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 665/1342] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:08.968707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:08.969827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:08.976336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.976789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.977609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.978044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.044065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:09.053199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f13c71f7-b7ff-4892-ac47-d31760765058 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088656 Aug 02 09:19:09.053788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 678/1343] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:08 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:09.225186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:09.227306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:09.233466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.233919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.234724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.235207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.268797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d2e657a-904e-4e67-8673-dab6fe5e3c77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047696 Aug 02 09:19:09.269417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 666/1344] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:09.431847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:09.434098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:09.441063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.441561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.442331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.442771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.475714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9f772de-3e61-4aa3-a79c-c1211b943b75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047808 Aug 02 09:19:09.476365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 679/1345] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:09.479694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:09.482921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:09.489756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.490205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.490971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.491403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.524699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-27752a3d-03d3-47c7-993b-b1df004cbff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049014 Aug 02 09:19:09.525305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 667/1346] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:09.769450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:09.770137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:09.778560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.779283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.780454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.780888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.933411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:09.941936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0eb44dc-437e-446b-bfa9-33126a458b19 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.177412 Aug 02 09:19:09.942557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 680/1347] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:10.075040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:10.075570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:10.082046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.082501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.083285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.083726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.152039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:10.159616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-065e2570-b5f4-443a-ab25-2914aa33c6b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088625 Aug 02 09:19:10.160192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 668/1348] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:10 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:10.280593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:10.282911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:10.289259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.289707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.290486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.290922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.322766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d7e9ca91-0a23-498c-8a39-a7e1582be3b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 02 09:19:10.323356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 681/1349] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:10.489233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:10.491886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:10.499792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.500239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.501044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.501516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.536524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-479d617c-6028-43a1-8a49-7cf85e2fc620 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052230 Aug 02 09:19:10.537104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 669/1350] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:10.538401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:10.540673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:10.547497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.547974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.548768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.549227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.580858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8733c556-f7b2-4a06-a162-64e1dc0de871 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046462 Aug 02 09:19:10.581484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 682/1351] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:10.964098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:10.964698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:10.971777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.972220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.972989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.973454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.124494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:11.139636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a10b9628-d3c2-406c-89ac-a62994fb1f23 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.179487 Aug 02 09:19:11.140710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 670/1352] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:11.180919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:11.181550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:11.188327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.188790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.189653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.190091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.256678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:11.275574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-292eee00-c769-4bd0-ba17-47ef2e78d8dd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.098499 Aug 02 09:19:11.276179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 683/1353] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:11 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:11.335972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:11.338340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:11.344940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.345610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.346575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.347112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.380243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c8f72d14-6aca-4776-869e-8d923521bfba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048201 Aug 02 09:19:11.380831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 671/1354] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:11.550091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:11.552705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:11.556206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:11.561288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.561952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.563353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.564466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.593919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:11.596496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:11.600317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f23b46fb-288e-402d-a2b8-487310d8a770 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055922 Aug 02 09:19:11.600910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 684/1355] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:11.603038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.603500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.604281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:11.604719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:11.639258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2bab336d-0216-4d8c-af9b-490afe9cb08c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049357 Aug 02 09:19:11.639865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 672/1356] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:12.168026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:12.168671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:12.175090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.175473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.176253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.176687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.296179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:12.296811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:12.303519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.303968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.304730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.305189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.309718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:12.317889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f8059baa-8d06-4f42-8d69-9cd89262cdcd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154412 Aug 02 09:19:12.318477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 685/1357] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:12.367371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:12.374942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0cebc508-4550-4d7e-a268-73534a2dc2e0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082681 Aug 02 09:19:12.376275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 673/1358] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:12 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:12.392019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:12.394247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:12.400295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.400738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.401551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.401996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.432942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f29b82f1-eb03-4753-b65e-8b7dc09dc0ca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Aug 02 09:19:12.433467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 686/1359] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:12.614376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:12.616617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:12.623292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.623744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.624524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.624965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.652077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:12.654436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:12.656325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-557daf8b-e70e-40fd-b7f7-8c7cecdba1a8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046414 Aug 02 09:19:12.657746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 674/1360] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:12.663429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.663894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.668132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.668132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.698731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-22472d5f-e03a-4de0-a38e-f60f367ef6cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050485 Aug 02 09:19:12.699228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 687/1361] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:13.340206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:13.340809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:13.347297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.347894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.348664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.349098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.396525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:13.397150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:13.403207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.403649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.404410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.404842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.471014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:13.479575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e56885b4-1899-4152-9193-0e559d405ba3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087343 Aug 02 09:19:13.480253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 688/1362] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:13 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:13.488185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:13.489724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:13.490592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:13.497957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c48f247e-92f4-4666-afd8-11dfbf3e7972 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161618 Aug 02 09:19:13.498356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.498800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 675/1363] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:13.498930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.499678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.500157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.505165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:13.532310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd92507f-b1be-4255-8d0e-ab4f1c298132 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050712 Aug 02 09:19:13.532902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 689/1364] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:13.670556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:13.673250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:13.675648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:13.681013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.681497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.682273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.682720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.711956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:13.713783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8adc2a5c-9ba4-4f02-8cb1-cc27f208f7a6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Aug 02 09:19:13.714270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:13.714392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 676/1365] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:13.721104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.721593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.722374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:13.722815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:13.754853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-259b9df2-e1fc-4da8-9a7f-38428e095d1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046869 Aug 02 09:19:13.755430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 690/1366] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:14.502495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:14.503115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:14.509363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.509901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.510914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.511534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.520487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:14.521156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:14.527406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.527854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.528628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.529061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.580834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:14.588778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fcd57068-68ab-4efd-a44a-f840a873dffc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090734 Aug 02 09:19:14.589390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 677/1367] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:14 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:14.594137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:14.596343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:14.602643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.603133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.603920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.604358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.635900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e4e193ae-bbef-4bd7-80f7-8f3586fc6777 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045445 Aug 02 09:19:14.636497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 678/1368] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:14.671373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:14.679398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c19ef6b-c128-497f-8247-c0eafe65be03 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163489 Aug 02 09:19:14.679978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 691/1369] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:14.726002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:14.728186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:14.735481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.735947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.736725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.737193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.739707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:14.768830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:14.770995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:14.771746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d61e0159-fe77-49fe-b52e-6ef800b6e287 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049727 Aug 02 09:19:14.772321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 679/1370] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:14.777698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.778154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.778938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:14.779376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:14.810495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a9814359-9229-46e3-b851-cc0335196bec tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046867 Aug 02 09:19:14.811042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 692/1371] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:15.610910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:15.611526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:15.617579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.618030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.618828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.619268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.648661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:15.650945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:15.658455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.658905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.659689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.660127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.686163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:15.691984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-49954e7e-30be-4a9a-9b2d-58e903e80e61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047741 Aug 02 09:19:15.692566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 693/1372] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:15.693770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5bf70e87-b52c-4bd3-b08e-0c405429aeda tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087430 Aug 02 09:19:15.694328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 680/1373] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:15 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:15.704218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:15.704905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:15.710954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.711433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.712204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.712633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.784637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:15.786948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:15.793498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.793944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.794730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.795169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.825826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4b35c794-8625-4cdc-a915-121e0be8df7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Aug 02 09:19:15.826410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 681/1374] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:15.832170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:15.834362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:15.840594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.840794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.841631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:15.842074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:15.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:15.856713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b66e0e9-535b-4e09-bed0-e4c4357124bb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156667 Aug 02 09:19:15.857325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 694/1375] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:15.873426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-572c227b-0f2d-4652-b13b-73c21418fd8f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045854 Aug 02 09:19:15.873908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 682/1376] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:16.705147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:16.707280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:16.713663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.714117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.714893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.715006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:16.715332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.715510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:16.722183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.722631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.723386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.723817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.745598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df10350d-a66d-4e79-9c0b-30afb783a3f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Aug 02 09:19:16.746167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 695/1377] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:16.785375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:16.793276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c778c54-3193-4818-bde4-8db35cf48cbb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082192 Aug 02 09:19:16.793833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 683/1378] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:16 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:16.838510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:16.840743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:16.847901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.848356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.849159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.849723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.878874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:16.879493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:16.879882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ee357f3-cd5c-4692-83ad-e0e9ed64d2a5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Aug 02 09:19:16.880668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 696/1379] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:16.885761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.886218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.886352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:16.886992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.887428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.888389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:16.895047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.895486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.896246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:16.896674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:16.926357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b021b305-e015-44ff-8157-c0a5ca664f35 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043727 Aug 02 09:19:16.926939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 697/1380] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:17.024463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:17.032057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5342af47-589d-41eb-b1a3-35039f488278 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158016 Aug 02 09:19:17.032649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 684/1381] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:17.760899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:17.763174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:17.769607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.770032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.770803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.771241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.800923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3a3c62ec-04ca-47bb-9117-44fa50eb1190 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 02 09:19:17.801521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 698/1382] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:17.814060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:17.814672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:17.821049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.821552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.822302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.822744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.884099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:17.891732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4df4769e-3922-41de-9c8b-e5daf8457472 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081581 Aug 02 09:19:17.892177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:17.892619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 685/1383] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:17 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:17.894602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:17.901232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.901693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.902476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.902915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.933485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ee8d2a1f-3913-4a38-a5b4-ac3997539ae4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Aug 02 09:19:17.934050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 699/1384] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:17.938791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:17.940996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:17.946975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.947427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.948192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:17.948630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:17.978089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-534a20ac-2307-45c2-b7ff-8c68eebdbd0f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Aug 02 09:19:17.978642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 686/1385] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:18.053985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:18.054599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:18.060624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.061076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.061872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.062312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.196593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:18.204647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cbc38480-1e96-4ff0-af65-a291ab088be0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154548 Aug 02 09:19:18.205242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 700/1386] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:18.812564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:18.815129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:18.822065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.822519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.823296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.823740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.854124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e1fc611-7bc4-447b-af14-14e4c83026e4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Aug 02 09:19:18.854691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 687/1387] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:18.912619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:18.913290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:18.920040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.920500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.921367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.921886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.946084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:18.948340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:18.955220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.955765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.956632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:18.957075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:18.987923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:18.989547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3329e333-bbf2-47e7-acff-3ea4d6d57a1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047483 Aug 02 09:19:18.990139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 688/1388] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:18.994864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:18.995797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4a94e7c8-06fe-4d14-a7bd-6f9ba8eda338 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087281 Aug 02 09:19:18.996382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 701/1389] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:18 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:18.997041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:19.004499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.004952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.005769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.006216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.038069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6fc9b72-95b0-4eaf-b653-b467e413f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046865 Aug 02 09:19:19.038645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 689/1390] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:19.227214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:19.227739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:19.233809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.234317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.235786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.236213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.375174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:19.383132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-afbd4c41-6a6f-4e22-ac67-ef5baa50ed2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159927 Aug 02 09:19:19.383716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 702/1391] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:19.866793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:19.869231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:19.877622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.878131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.878978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:19.879509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:19.913463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f304a910-024c-4995-8815-dbda707d42f9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051117 Aug 02 09:19:19.913994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 690/1392] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:20.002587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:20.004834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:20.011808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.012270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.013189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.013499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.019003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:20.019939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:20.027958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.028484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.029512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.030089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.047603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b0aac5a3-0092-4740-b0ef-d461a9367c9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050173 Aug 02 09:19:20.048259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 703/1393] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:20.053159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:20.055351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:20.061605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.062056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.063363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.063800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.095213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0a35767-3f4b-49dc-b56c-f7a45f26cd87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045855 Aug 02 09:19:20.095819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 704/1394] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:20.099511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:20.107100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1c753c03-5816-462b-9430-7f8283e2032f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092599 Aug 02 09:19:20.107662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 691/1395] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:20 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:20.404125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:20.404737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:20.410925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.411375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.412149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.412613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.563667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:20.567261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:20.571988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d6ff6475-70fa-409b-a82d-97e823286c74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.171909 Aug 02 09:19:20.572582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 705/1396] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:20.928218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:20.930725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:20.937554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.938093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.938959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:20.939406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:20.970975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-22994633-dc3d-463a-929d-e13a9f095048 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046744 Aug 02 09:19:20.971541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 692/1397] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:21.063804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:21.066286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:21.073127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.073599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.074365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.074798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.108070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:21.109226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d3c543ad-92e9-44c3-997d-898d080b81ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049766 Aug 02 09:19:21.110519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 706/1398] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:21.110673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:21.118055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.118528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.119397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.119837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.130090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:21.130090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:21.135814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.136266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.137047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.137516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.152922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c39946d-da96-4aa9-a6d6-5dc665730978 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049102 Aug 02 09:19:21.153555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 693/1399] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:21.204114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:21.212246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd0a33d6-bcd7-4e3f-96b5-99f604037af1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087916 Aug 02 09:19:21.212839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 707/1400] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:21 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:21.595078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:21.595712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:21.601938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.602393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.603177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.603623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.745505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:21.753608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c0508699-0a16-491f-95a9-67bce7c84e69 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162705 Aug 02 09:19:21.754217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 694/1401] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:21.983596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:21.985909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:21.992733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.993211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:21.994003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:21.994438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.025836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e28f0579-8a98-4980-8be9-32abdb6d2d5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Aug 02 09:19:22.026417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 708/1402] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:22.122819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:22.125631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:22.132437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.132891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.133700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.134143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.160976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:22.168121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:22.169767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e4ca0927-77f2-48ae-8468-f1d3d7333692 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050911 Aug 02 09:19:22.170359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 695/1403] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:22.170566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:22.177050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.177563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.178353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.178797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.210875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b8e37ceb-3f77-4891-b964-79bc3531c569 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048394 Aug 02 09:19:22.211464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 709/1404] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:22.233185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:22.233797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:22.240943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.241698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.242485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.242923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.308275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:22.316841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e0ec708c-3d5c-4b04-8e55-fa243f4b0ae2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087531 Aug 02 09:19:22.317550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 696/1405] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:22 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:22.775593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:22.776217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:22.784090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.784540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.785379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:22.785819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:22.928793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:22.936812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b712cd43-9971-4078-92d6-582e834187c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.165178 Aug 02 09:19:22.938038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 710/1406] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:23.038572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:23.040683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:23.047176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.047606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.048391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.048829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.079922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ddc446ba-b06e-467d-acc3-c0ae1005c906 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Aug 02 09:19:23.080507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 697/1407] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:23.182662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:23.184902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:23.192508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.192958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.193774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.194214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.224954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:23.227150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:23.227679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-048de8e7-4446-46ec-a0c8-a6a06c899213 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049006 Aug 02 09:19:23.228326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 711/1408] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:23.233708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.234161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.234954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.235360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.268962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66f1ce8d-fea6-4f54-8e52-945b401c4bf1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048601 Aug 02 09:19:23.269583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 698/1409] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:23.337938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:23.338500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:23.345913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.346385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.347171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.347609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.428964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:23.436765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30749748-1b14-476e-8dec-21f514bed808 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.102790 Aug 02 09:19:23.437438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 712/1410] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:23 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:23.960471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:23.961328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:23.968236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.969458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:23.970338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:23.970776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.092115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:24.095123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:24.101707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.102160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.103239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.103681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.119660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:24.129553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13d47a6b-e2c9-42ae-9c7a-793612417bbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173963 Aug 02 09:19:24.130553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 699/1411] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:24.142147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8a95b12-ce13-470b-8482-1f7da378ba76 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053933 Aug 02 09:19:24.142732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 713/1412] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:24.240799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:24.242975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:24.249555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.250169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.250945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.251379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.281779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:24.284583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc127599-c229-40d2-a27d-8a8660874012 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Aug 02 09:19:24.285178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 700/1413] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:24.285311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:24.292187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.292648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.293505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.293944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.325622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-80fc9d99-1d39-4c6a-b9d7-d053f03bab64 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047950 Aug 02 09:19:24.326419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 714/1414] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:24.458452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:24.459058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:24.465357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.465800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.466572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:24.467000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:24.546096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:24.553911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-64f3639c-26d5-4640-90c8-ffc3eec71a27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.099359 Aug 02 09:19:24.554485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 701/1415] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:24 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:25.152426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:25.153040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:25.156505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:25.159496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:25.160381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.160829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.161634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.162066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.167319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.167920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.168865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.169465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.210189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-61dac8e3-9518-4dd7-8b79-031db83b754a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059386 Aug 02 09:19:25.211130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 702/1416] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:25.300703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:25.304280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:25.309961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:25.313040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.313533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.314315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.314751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.317843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4d1f0bc8-373b-4df0-b4ce-8d2c8cc09ee8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169573 Aug 02 09:19:25.318666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 715/1417] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:25.342912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:25.345879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-303a156c-d044-49ea-83b3-3ac3fa14484c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053600 Aug 02 09:19:25.346239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:25.346694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 703/1418] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:25.353797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.354340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.355297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.355876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.389417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1987d401-53f5-4328-8678-b8c5326d9e97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051551 Aug 02 09:19:25.389987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 716/1419] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:25.577161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:25.578668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:25.585011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.585498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.586281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:25.586725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:25.657249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:25.666961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b1203a05-a905-4553-af7b-f1c749ee8872 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093740 Aug 02 09:19:25.667791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 704/1420] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:25 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:26.222157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:26.224269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:26.230685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.231125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.231900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.232331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.266953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95a8b26b-8589-485b-a27c-140ab7d9c4fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048769 Aug 02 09:19:26.267537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 717/1421] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:26.339849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:26.340581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:26.347908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.348362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.349180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.349621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.360904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:26.363131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:26.374405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.375984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.376408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.377257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.409218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7543c01a-2f85-446d-bfbe-1f079db192e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054391 Aug 02 09:19:26.410011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 718/1422] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:26.414547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:26.417015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:26.423973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.424417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.425243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.425688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.457444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0f84f88-bb44-4d0d-b123-02d6452ae46c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046506 Aug 02 09:19:26.458263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 719/1423] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:26.503550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:26.511352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f9650e7d-a8fb-420d-b6a0-61d3d91b8ec8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.175432 Aug 02 09:19:26.511956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 705/1424] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:26.690774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:26.691418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:26.697809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.698259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.699038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:26.699482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:26.766249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:26.774225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d72f79c9-1013-487f-8d0e-86433e9db7ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087570 Aug 02 09:19:26.774814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 720/1425] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:26 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:27.279626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:27.282522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:27.289531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.289981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.290756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.291199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.321864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c715e844-8dab-41cb-ac71-8c7a091371e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Aug 02 09:19:27.322452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 706/1426] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:27.423465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:27.425699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:27.432266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.432706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.433550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.433942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.470187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:27.472466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:27.473979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e242623f-6eff-422a-8879-53dc7bc6d628 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055961 Aug 02 09:19:27.474795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 721/1427] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:27.479674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.480123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.480901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.481381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.513322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ac83ad55-e7bc-44b0-b61c-0ed1e562f34d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047691 Aug 02 09:19:27.513890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 707/1428] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:27.533804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:27.534338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:27.540704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.541182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.541965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.542421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.563782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:27.694743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:27.703086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-724ba5bf-25be-432c-ab15-1a098d29acd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173326 Aug 02 09:19:27.703697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 722/1429] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:27.798488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:27.799021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:27.806149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.806659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.807605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:27.808104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:27.884958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:27.896009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3dd8d01b-b372-46d4-9452-4bbe8908a82e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.101186 Aug 02 09:19:27.896881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 708/1430] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:28.335434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:28.338113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:28.345094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.345578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.346604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.347254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.378410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b54d68d2-ff80-4ae7-a20c-52c24e4845ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Aug 02 09:19:28.379003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 723/1431] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:28.487534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:28.489734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:28.496407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.496861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.497690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.498129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.526350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:28.528622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:28.530304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b85c370d-7b98-4d9b-ac22-5447dcb999be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Aug 02 09:19:28.531863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 709/1432] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:28.536649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.537095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.537904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.538340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.569170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-efc08b6b-f9de-453e-9fb3-56642e07f8be tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046785 Aug 02 09:19:28.569763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 724/1433] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:28.725554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:28.726073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:28.732086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.732530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.733326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.733844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.873900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:28.884081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2054c0ed-f38e-4bd6-841b-3ae5a387cdfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162517 Aug 02 09:19:28.884679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 710/1434] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:28.918729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:28.919360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:28.925888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.926339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.927124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:28.927556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:28.993206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:29.002011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4a75cfa-e6d3-444b-9b22-c311ed7d0d90 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086967 Aug 02 09:19:29.002598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 725/1435] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:28 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:29.391950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:29.394208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:29.400378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.400832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.401660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.402100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.433478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef7e09b8-0fed-44f9-8b34-cb63087049b0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Aug 02 09:19:29.434050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 711/1436] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:29.543772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:29.546139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:29.554312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.554766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.555564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.556005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.581855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:29.584087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:29.588314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01bc9e86-7a63-4639-91ec-4a4740d92574 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Aug 02 09:19:29.588915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 726/1437] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:29.590883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.591334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.592109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.592539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.608161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:29.628233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95435970-6de5-431b-9f11-2a62e94f4fd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050994 Aug 02 09:19:29.628819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 712/1438] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:29.745345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:19:29.745581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:19:29.909225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:29.909843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:29.916530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.916973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:29.917783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:29.918216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.023291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:30.024018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:30.030090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.030625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.031515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.032159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.053794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:30.061440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-27d7b04e-3019-48ae-9982-96593fd24eff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156480 Aug 02 09:19:30.062013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 727/1439] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:30.095887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:30.103346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26428f56-c347-40a9-8c93-9a7013dec17b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084094 Aug 02 09:19:30.103905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 713/1440] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:30.446174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:30.448374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:30.454757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.455209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.455992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.456433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.486366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-307c7db6-97b5-49bd-844f-8f522f617e81 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 02 09:19:30.486931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 728/1441] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:30.600923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:30.603117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:30.610134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.610462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.611229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.611669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.640029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:30.641681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-479ea43a-3249-4c66-baed-5053d45139b1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 02 09:19:30.642412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 714/1442] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:30.643261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:30.649790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.650243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.651006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:30.651441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:30.682522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f2d56a0a-76d9-41d8-be9d-97b6ef05bf55 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046553 Aug 02 09:19:30.683075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 729/1443] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:31.084431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:31.085051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:31.091515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.092038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.092828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.093473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.125432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:31.126151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:31.133419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.135601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.135601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.135601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.207067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:31.215065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f07eb624-77ea-43ce-91f0-34c6620d726f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.094696 Aug 02 09:19:31.215654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 730/1444] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:31 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:31.255334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:31.263155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d6ed1d62-4c0e-48da-848b-d0fa378e2c33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.182569 Aug 02 09:19:31.263655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 715/1445] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:31.499027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:31.502333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:31.508897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.509722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.511146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.511929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.548095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2058980e-123d-4cb8-8a88-e0f359761939 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052961 Aug 02 09:19:31.548590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 731/1446] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:31.653465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:31.655607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:31.662150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.662593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.663355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.663788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.694992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:31.696102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4bd1e59d-1a2f-4533-b90d-7873f3d334a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Aug 02 09:19:31.696677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 716/1447] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:31.697472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:31.704016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.704454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.705276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:31.705977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:31.735366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-36047d4f-419c-4c57-967c-9d62117f28b0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044208 Aug 02 09:19:31.736065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 732/1448] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:31.803279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:19:31.803474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:19:32.237033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:32.237615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:32.243890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.244348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.245120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.245564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.285729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:32.286351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:32.292583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.293034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.293854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.294355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.310415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:32.319851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9b363a88-b759-451a-a75b-2d3eb02621f5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087758 Aug 02 09:19:32.320432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 717/1449] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:32 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:32.437836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:32.445403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6a036b54-ed64-4dae-b039-5b858bb0c7a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163575 Aug 02 09:19:32.445975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 733/1450] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:32.560182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:32.562378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:32.568698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.569208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.569988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.570426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.603930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ce843062-1169-4bc4-9b31-023ec09082ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Aug 02 09:19:32.604516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 718/1451] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:32.708745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:32.710947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:32.713382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:32.719409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.719863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.720653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.721095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.748089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:32.751029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:32.752045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7b57a89-f54d-4120-a33e-b957c089a2ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047155 Aug 02 09:19:32.752629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 734/1452] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:32.758041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.758492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.759264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:32.759696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:32.791085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c0d7be17-c074-4172-8a38-43ee30ebae23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046943 Aug 02 09:19:32.791656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 719/1453] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:33.341164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.341787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:33.348209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.348662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.349463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.349909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.411122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:33.418640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ab9f68f-bfd3-4558-914d-b6c0a98190a0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081455 Aug 02 09:19:33.419199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 735/1454] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:33.466380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.466996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:33.473280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.473737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.474495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.474927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.616618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.618690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:33.618849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:33.625295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.625791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.626246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd9e00c9-1a94-44f6-b2f3-76291c2d9bc1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163725 Aug 02 09:19:33.626868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.627093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 720/1455] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:33.627312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.658155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7e09fc48-a8a7-4356-a7e2-623128056a5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Aug 02 09:19:33.658723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 736/1456] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:33.764380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.767184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:33.773656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.774102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.774870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.775308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.803700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.805421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0f4f36ea-e12d-45bb-806c-4ed1676d37c7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 02 09:19:33.805925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:33.806041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 721/1457] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:33.812502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.812982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.813797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.814239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.843888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45716474-1fd9-4d75-9938-b23483d63922 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043491 Aug 02 09:19:33.844592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 737/1458] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:34.440256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:34.440871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:34.447002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.447453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.448215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.448655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.513095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:34.520616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b19a1bab-b641-4a2b-aa50-3142e9013de4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084929 Aug 02 09:19:34.521190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 722/1459] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:34 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:34.648498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:34.649236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:34.655524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.656000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.656871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.658063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.671778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:34.675213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:34.682178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.682620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.683396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.683843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.715593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-03f99cf0-c5b0-4825-8b77-b2bcdc129bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 Aug 02 09:19:34.716292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 723/1460] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:34.809699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:34.818544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:34.820704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d78343fc-696d-4eb8-8c63-7f38e1a17502 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.176100 Aug 02 09:19:34.820987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:34.821328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 738/1461] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:34.828258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.830506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.831332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.831788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.860531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:34.863977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:34.865781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-551309ad-86ae-45dd-a832-2f8f82f455f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051238 Aug 02 09:19:34.866364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 724/1462] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:34.873532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.874259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.875515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:34.876421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:34.883251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:34.913504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1faf5cd2-1683-46ea-9821-f209e408b8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060692 Aug 02 09:19:34.914124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 739/1463] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:35.544405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:35.545587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:35.556045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.556494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.557335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.558053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.622145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:35.630974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26451894-2ebd-4e39-b366-98a15499c142 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092961 Aug 02 09:19:35.631558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 725/1464] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:35 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:35.728087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:35.730276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:35.736521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.736971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.737779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.738224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.770401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ef884ce-6289-4ff4-b39b-271f72969eb3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Aug 02 09:19:35.770979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 740/1465] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:35.842990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:35.843541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:35.846605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:35.852162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.852612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.853413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.853850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.879538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:35.881779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:35.888471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.888916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.889720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.890154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.926454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-974d74d6-8bf7-43f9-821d-b31274d8bec5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052311 Aug 02 09:19:35.927054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 741/1466] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:35.931836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:35.934013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:35.940677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.941154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.941944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:35.942376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:35.972098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32139a61-b683-42d0-8bd5-016c9ea92b38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043892 Aug 02 09:19:35.972681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 742/1467] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:35.995043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:36.004094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8f8d0329-3c78-4da9-9c2e-e092c39ea692 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164546 Aug 02 09:19:36.004677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 726/1468] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:36.652765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:36.653477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:36.660107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.660566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.661377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.661817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.725575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:36.733382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-09793fa7-9207-45e0-9dc4-66d7f51c9d29 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084477 Aug 02 09:19:36.733963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 743/1469] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:36.783724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:36.786021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:36.792192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.792639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.793444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.793876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.822887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e0277ea7-8cbf-4908-8398-19657bd3542e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Aug 02 09:19:36.823443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 727/1470] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:36.939462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:36.941667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:36.948206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.948656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.949461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.949896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.979794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41070383-cbd4-4e99-8187-68d3e54ede0a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Aug 02 09:19:36.980379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 744/1471] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:36.984205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:36.986977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:36.993602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.994059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.994836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.995277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.025713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7c96587a-ddf6-4ec2-ac67-dd128069147a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045548 Aug 02 09:19:37.025959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:37.026288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 728/1472] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:37.026442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:37.033196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.035161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.035161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.035161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.178387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:37.186111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0a58aee1-abc6-4af3-a421-8c74f7d8483e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164194 Aug 02 09:19:37.186694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 745/1473] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:37.755360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:37.755975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:37.761995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.762449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.763219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.763658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.768212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:37.824788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:37.833181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d3e7cb98-9c43-4c39-b1b8-87a340521955 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081981 Aug 02 09:19:37.833754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 729/1474] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:37 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:37.835849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:37.838191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:37.844295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.844778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.845525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.845957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.874659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cb5cf8f1-3f93-4b69-8931-730e546cf1cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Aug 02 09:19:37.875784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 746/1475] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:37.992005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:37.994246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:38.001767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.002253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.003066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.003526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.033589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c83578c-eae3-4c05-acb3-0cae628183b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Aug 02 09:19:38.034155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 730/1476] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:38.038656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:38.040810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:38.047567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.048148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.048929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.049403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.079485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9061ca46-9bef-4269-bbec-dcf9b410d3eb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043951 Aug 02 09:19:38.080054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 747/1477] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:38.207219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:38.207872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:38.214195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.214651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.215418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.215857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.349965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:38.357500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b79d81ca-cd35-4e07-892c-a6ee0ae2fc48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154211 Aug 02 09:19:38.358074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 731/1478] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:38.854392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:38.855018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:38.862091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.862546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.863325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.863831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.887793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:38.892659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:38.899286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.899743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.900540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.900981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.939744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:38.947816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3bcae31-0b4e-41ce-9bf8-69c4754331e2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.097504 Aug 02 09:19:38.948351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-152df4dd-cadb-4493-b5c8-07ecdec69110 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064445 Aug 02 09:19:38.948523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 748/1479] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:38 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:38.948916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 732/1480] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:39.046562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:39.049461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:39.056019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.056469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.057279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.057719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.088000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-458e77dd-1f34-49be-a281-110d68560672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 02 09:19:39.088576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 749/1481] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:39.091433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:39.093637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:39.100221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.100676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.101550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.101989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.133330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-51e7948f-c9e1-4d27-91b7-22a3207eee48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045702 Aug 02 09:19:39.133821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 733/1482] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:39.380475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:39.381088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:39.388458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.389035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.390054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.390708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.525790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:39.534284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f6f56bdb-b727-4791-aeba-c1ea3da0b203 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158888 Aug 02 09:19:39.534869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 750/1483] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:39.595838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:19:39.596116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:19:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:19:39.961309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:39.963481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:39.969514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:39.970161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:39.970728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.971184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.971956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.972400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.976180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.976664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.977468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.977909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.003944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-08fa6c6b-7e7e-46ef-bdf8-69a78641ade0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Aug 02 09:19:40.004523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 734/1484] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:40.040943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:40.048599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f142c2fe-3d21-4ef7-852f-7636d49cf23e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083652 Aug 02 09:19:40.049194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 751/1485] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:40.099596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:40.101778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:40.108207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.108655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.109558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.110002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.139558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2ac5ffdd-43c1-4013-b4ed-9c97e52c3ccd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Aug 02 09:19:40.140292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 735/1486] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:40.146543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:40.148711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:40.155149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.156009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.156697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.158309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.188506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-28ef446b-1f86-485f-bba5-fc1d3553070e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045480 Aug 02 09:19:40.189078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 752/1487] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:40.556225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:40.556840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:40.563474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.563910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.564686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.565149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.703051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:40.710807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b8811bee-dd9a-4e8c-9c3c-154c9e68415d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158457 Aug 02 09:19:40.711396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 736/1488] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:41.017506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:41.019756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:41.025943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.026392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.027185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.027600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.057513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34c356a4-9852-4249-9b19-da14d8f1e39d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Aug 02 09:19:41.058212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 753/1489] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:41.070040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:41.070657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:41.076655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.077130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.077935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.079091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.149538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:41.151972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:41.154213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:41.157457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3913e198-4a46-44f0-bc4d-9b2cff8a809c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091229 Aug 02 09:19:41.158047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 737/1490] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:41 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:41.162135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.162744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.163526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.163963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.196755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-381756d0-54db-4941-9cda-658594937e0c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Aug 02 09:19:41.197281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 754/1491] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:41.200253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:41.202505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:41.209203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.209650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.210411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.210840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.241842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5f4845a0-adc0-4422-a2e1-24b92845da14 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045682 Aug 02 09:19:41.242403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 738/1492] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:41.732318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:41.732966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:41.739900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.740384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.741181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.741674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.888833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:41.893420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:41.898216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2b43b0dd-c740-4e25-82df-2d6c65825fd3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169778 Aug 02 09:19:41.898797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 755/1493] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:42.069868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:42.072070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:42.078772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.079568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.080370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.080816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.112464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6390ea8d-7a46-473b-8de1-65f3f6b4be70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 Aug 02 09:19:42.113034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 739/1494] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:42.179140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:42.179757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:42.186400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.186889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.187738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.188210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.208473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:42.210666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:42.216701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.217179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.218018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.218447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.249488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2d7012d5-5edb-4ed6-8765-f4d6b1c669ef tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Aug 02 09:19:42.251035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 740/1495] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:42.252345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:42.260028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:42.260247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ce43933-0b42-4a81-9db7-c0ecc0daec01 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085120 Aug 02 09:19:42.260611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 756/1496] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:42.262315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:42.269099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.269569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.270388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.270764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.300067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c841c7f3-cb1e-4f3d-8f53-b12a3d2a1877 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043809 Aug 02 09:19:42.300630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 741/1497] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:42.919773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:42.920392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:42.927173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.927624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.928399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.928834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.063690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:43.071407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3931eea8-3dcb-4729-b24c-c7f4e24184d4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155621 Aug 02 09:19:43.071982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 757/1498] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:43.124170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:43.127394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:43.134069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.134519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.135297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.135738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.166259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-36159adf-ea2e-4572-a6bf-4f65a54bd4d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Aug 02 09:19:43.166829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 742/1499] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:43.262797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:43.264992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:43.272406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.272857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.273666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.274107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.281817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:43.282440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:43.289088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.289604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.290360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.290793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.305688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e2e947b4-f2e0-4cbb-a358-db75e889bb4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046969 Aug 02 09:19:43.306466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 758/1500] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:43.311927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:43.314201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:43.320215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.320662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.321471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.321905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.352797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-47b2be21-d4c7-4535-a400-4b605af86a7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044661 Aug 02 09:19:43.353410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 759/1501] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:43.357796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:43.365981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc30f01e-2572-4d27-b78b-d9be69a19795 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088632 Aug 02 09:19:43.366548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 743/1502] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:43 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:44.093420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:44.094298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:44.100177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.100618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.101423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.101848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.179928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:44.182210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:44.189963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.190421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.191206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.191644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.222041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6b408646-b6fc-4ee9-8bb5-5c4d817e36cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046187 Aug 02 09:19:44.222619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 744/1503] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:44.240707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:44.248250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-861178e7-7551-478f-aaf9-1ba0e7c4210d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158812 Aug 02 09:19:44.248819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 760/1504] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:44.318907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:44.321118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:44.327165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.327621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.328576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.328998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.353932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:44.358893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d5bdd92-6482-4010-be3a-9dcd20b25c44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 Aug 02 09:19:44.360255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 745/1505] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:44.366021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:44.368178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:44.374920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.375968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.377079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.377559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.386943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:44.387576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:44.393746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.394190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.394951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.395378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.407759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-541ae3ce-2383-47d6-900a-25c1ab1e068b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045704 Aug 02 09:19:44.408340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 761/1506] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:44.459137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:44.466605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8c1ded4b-5db4-46f2-8e93-d34270ead3c3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083540 Aug 02 09:19:44.467169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 746/1507] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:45.235154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:45.237410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:45.243423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.243870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.244657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.245092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.270887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:45.271513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:45.275408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3fd3cc19-8edb-4936-9f12-6be47b90e21b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Aug 02 09:19:45.275983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 762/1508] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:45.278590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.279109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.279898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.280341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.371932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:45.374135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:45.381261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.381714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.382480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.382910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.413584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-73302589-f549-4ca2-a291-1a380e676bc3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Aug 02 09:19:45.414162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 763/1509] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:45.415343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:45.424794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:45.425346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6b2a95b3-0e2f-4e0c-8cc0-480f7f710fdc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158503 Aug 02 09:19:45.425989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 747/1510] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:45.427224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:45.433477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.433932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.434713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.435151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.464913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30d3cf41-f7c2-47df-9c5d-dc8838c3c8ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Aug 02 09:19:45.465507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 764/1511] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:45.487038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:45.487571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:45.493535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.493977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.494730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:45.495161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.563525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:45.571076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-deca8393-f1c0-437a-8e17-e58e9069f86b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088707 Aug 02 09:19:45.571637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 748/1512] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:45 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:46.288567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:46.290741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:46.297371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.297890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.298665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.299096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.327668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6349d681-a800-4d40-b586-a232d0d1e3c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Aug 02 09:19:46.328318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 765/1513] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:46.426001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:46.428196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:46.434770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.435214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.435972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.436434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.446872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:46.447519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:46.454967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.455499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.456364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.456811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.467130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9591a807-e656-4a9f-b93a-5f30d923dd06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Aug 02 09:19:46.467737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 749/1514] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:46.477807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:46.479943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:46.485933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.486401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.487225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.487663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.518600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a3b08c75-917f-446c-bff4-a422f4e69d97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044546 Aug 02 09:19:46.519171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 750/1515] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:46.591845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:46.592259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:46.595280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:46.599157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.599612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.600395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.600843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.602925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc0d0812-ea0e-49ad-8854-993d979add18 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159945 Aug 02 09:19:46.603511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 766/1516] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:46.663979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:46.671421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d681a44-9603-438c-85dc-931e7ad44965 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083716 Aug 02 09:19:46.672030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 751/1517] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:47.340101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.342333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.348626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.349075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.349878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.350322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.381198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9e9b4d8-9caf-4f6f-bbcd-5b2dcdcbc87b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 02 09:19:47.381782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 767/1518] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:47.480863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.483062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.489936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.490382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.491160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.491593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.523027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-983ba58f-424c-4228-84e3-af459fde9204 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Aug 02 09:19:47.523592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 752/1519] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:47.532246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.534846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.541462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.541970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.542676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.543104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.573837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ffa7359c-b7a9-4b30-9a32-852d7cf2cb9f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046318 Aug 02 09:19:47.574441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 768/1520] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:47.626070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.626905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.633164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.633621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.634391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.634822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.693471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.694095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.708768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.708768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.708768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.708768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.768111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:47.776116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ffd19c12-e318-4d8a-afc0-d9232bb27a1e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086593 Aug 02 09:19:47.777077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 769/1521] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:47.779449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:47.787518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-72cf55c2-aa88-4281-b3b5-a389e0dbf730 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166383 Aug 02 09:19:47.788488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 753/1522] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:48.394540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.396700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.403319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.403761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.404530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.404961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.434668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c54c4b6b-bf8a-480c-84ea-e38fec3b4e2f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Aug 02 09:19:48.435238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 770/1523] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:48.535846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.538154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.544906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.545381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.546153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.546629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.578554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c658a6b-4af6-4b3e-9db7-7f37ef568ca4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046115 Aug 02 09:19:48.579249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 754/1524] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:48.586369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.588581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.599743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.600195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.600992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.601465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.632349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-09ebd132-2c13-4395-9ed5-4719cfa52b4b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049914 Aug 02 09:19:48.632933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 771/1525] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:48.796050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.797276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.805480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.805938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.806729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.807170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.808707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.809346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.816372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.816810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.817616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.818051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.847282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:48.884247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:48.891614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f53f9a64-ade8-40cb-b733-5a253592179a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.099472 Aug 02 09:19:48.892303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 755/1526] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:48.985855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:48.993748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3da96ade-0d1e-4221-81ab-ef8e2df17b24 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.188831 Aug 02 09:19:48.994328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 772/1527] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:49.447847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:49.450127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:49.457012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.457492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.458263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.458705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.490803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-55b627b7-3146-42bb-89cc-235bc61f8b1e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Aug 02 09:19:49.491381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 756/1528] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:49.591338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:49.594310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:49.601272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.601726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.602526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.602962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.634876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da2d2fb0-507e-4ac0-81a1-d40a54b3089c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Aug 02 09:19:49.635464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 773/1529] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:49.645314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:49.647538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:49.654149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.654595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.655372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.655811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.690105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-549366f4-b7ec-4e4c-b843-f021e79526d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048851 Aug 02 09:19:49.690683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 757/1530] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:49.912805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:49.913468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:49.922566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.923056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.924205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.924351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.994409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:50.003013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2a7f21a6-40a0-404e-ab68-99c58615c368 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.094163 Aug 02 09:19:50.003608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 774/1531] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:50.016729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:50.017527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:50.024278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.024738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.025553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.025991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.166870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:50.175225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-378bb61c-2190-4d74-ba10-a4a516561def tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163165 Aug 02 09:19:50.175799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 758/1532] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:50.503886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:50.506110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:50.512289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.512738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.513540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.514011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.544930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9d1b5b3e-281b-410e-aa31-87a539a1ab9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046012 Aug 02 09:19:50.546179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 775/1533] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:50.647791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:50.649977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:50.658597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.659049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.659828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.660267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.693862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7f43e94-ead2-4c07-8288-ec8952b16c65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049978 Aug 02 09:19:50.694456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 759/1534] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:50.702825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:50.705030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:50.711813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.712262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.713042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:50.713509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.747293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4f44ddfe-b1e7-4b8f-8a64-ab08b7b5b87a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048568 Aug 02 09:19:50.747893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 776/1535] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:51.025594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.026210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.034001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.034454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.035237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.035675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.111520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:51.119952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-53cda5dc-0877-491a-b19c-fedc92a474d6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.098325 Aug 02 09:19:51.120544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 760/1536] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:51.197629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.198164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.205566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.205953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.206732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.207176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.379512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:51.388226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-926bd7f8-cee7-463e-8cc6-c78299e82d75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.194654 Aug 02 09:19:51.388817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 777/1537] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:51.558902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.561128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.567902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.568350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.569164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.569612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.601459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a8dcc777-e18c-4cff-8c12-fa32ddc97420 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046622 Aug 02 09:19:51.602036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 761/1538] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:51.707121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.709759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.716562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.717012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.717829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.718327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.749900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b055d906-4c28-4742-b3be-8a18f586695e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047673 Aug 02 09:19:51.750474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 778/1539] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:51.760114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.762297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.769591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.770038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.770814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.771245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.786151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:51.802705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6ce89e5-0c02-448e-a1e4-a4f0995425de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046521 Aug 02 09:19:51.803286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 762/1540] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:52.148083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.148733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.155096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.155545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.156518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.156956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.220036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:52.227640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ed93a1a8-2cf0-4993-bee5-fa3796afaf6e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083551 Aug 02 09:19:52.228212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 779/1541] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:52.415949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.416597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.423265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.423709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.424474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.424912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.565870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:52.573420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15e89940-7f4e-4c37-a6ed-80725f3126d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161365 Aug 02 09:19:52.573994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 763/1542] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:52.613969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.616142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.622215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.622657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.623502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.623953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.653818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b33f913-56f5-487f-bd36-e7ab75416434 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 02 09:19:52.654383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 780/1543] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:52.762789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.765871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.772412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.772867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.773674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.774119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.803596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b62ab647-b6c2-4e91-aa52-d9854b6e46db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 02 09:19:52.804167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 764/1544] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:52.816844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.819196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.825987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.826470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.827250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.828538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.858167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ee97723-9ec7-47ce-a437-dac35b2b5cce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046575 Aug 02 09:19:52.859077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 781/1545] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:53.248024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.248779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.256045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.256587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.257400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.257842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.324362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:53.336774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d9aa6c27-17fd-4ae9-b56a-91af12bfa61b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092337 Aug 02 09:19:53.337757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 765/1546] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:53.595861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.596504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.602592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.603044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.603814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.604252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.667851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.670062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.676876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.677388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.678161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.678603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.709337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-363eb181-e816-425a-8c03-bb95a11ee858 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Aug 02 09:19:53.709906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 766/1547] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:53.740355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:53.747879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56ddbb37-34c8-47c1-b30a-9455e621a084 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156464 Aug 02 09:19:53.748467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 782/1548] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:53.816145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.818381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.824889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.825347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.826114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.826548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.855506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79496a44-ae25-4d8c-9ddb-19cb09369767 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Aug 02 09:19:53.856057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 767/1549] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:53.870596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.872793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.879548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.879994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.880759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.881217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.911692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5366b49-a76d-4b76-90a3-8462b07b2412 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Aug 02 09:19:53.912294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 783/1550] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:54.366363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.366894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.372818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.373344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.374171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.375165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.436471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:54.444562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-16928cca-1eb5-4821-9c58-1f12a980cd0a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082488 Aug 02 09:19:54.445147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 768/1551] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:54.722719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.724773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.726670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:54.731808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.732252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.733010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.733464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.761836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c7a4f2c-a27d-4720-b8db-eb9549e392da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Aug 02 09:19:54.762377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 784/1552] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:54.769961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.770565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.776454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.777271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.778025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.778461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.867874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.870135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.877057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.877698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.878379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.878824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.910342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-80bd68a3-e1ab-4927-a27e-a493a1003ab7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046350 Aug 02 09:19:54.911226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 785/1553] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:19:54.915388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:54.924523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.926885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.926996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-61593507-4b9b-4866-a65d-f8ee92dd13cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161381 Aug 02 09:19:54.927722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 769/1554] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:54.932845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.933334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.934111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.934575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.964925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ef199a42-804c-495e-ad73-e7fc54e38c48 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044865 Aug 02 09:19:54.965517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 786/1555] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:55.465660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.466280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.472976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.473491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.474270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.474812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.544168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:55.551831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-550913aa-e444-44ef-af4b-710550962f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090174 Aug 02 09:19:55.552407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 770/1556] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:55.776240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.778432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.785069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.785546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.786317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.786752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.820493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab19c361-e4f4-460b-94fa-fab4dba8b650 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Aug 02 09:19:55.821068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 787/1557] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:55.922606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.924810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.931286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.931743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.932518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.932961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.951227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.951811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.960614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.961060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.961855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.962287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.964543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a9711910-c874-4773-be16-3f97feaa447b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Aug 02 09:19:55.965140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 771/1558] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:55.977785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.979926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.985914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.986370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.987148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.987592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.018539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-11d6af08-61da-4090-89cc-c46805861198 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044549 Aug 02 09:19:56.019106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 772/1559] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:19:56.098653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:56.106167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7428e458-62c9-4b24-bb7d-96fb706361b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158910 Aug 02 09:19:56.106732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 788/1560] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:56.572082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:56.572706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:56.579493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.579946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.580721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.581202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.643762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:56.651290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-552def21-0b60-4073-b7fb-0e76624f38a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083328 Aug 02 09:19:56.651859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 773/1561] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:56.833446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:56.835618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:56.841789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.842242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.843553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.844669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.848581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:56.877652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc26f4c7-9222-481e-bc84-c5746fa99d43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048352 Aug 02 09:19:56.878229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 789/1562] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:56.977609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:56.979811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:56.987677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.988127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.988899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.989372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.020242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f774e9e3-a429-4e86-974c-1401febd5ac7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Aug 02 09:19:57.020802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 774/1563] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:57.031409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:57.033627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:57.039700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.040144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.040910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.041365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.071966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4bc0f101-cc93-48ef-973b-a80dff8a3c87 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044824 Aug 02 09:19:57.072530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 790/1564] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:57.128863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:57.129500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:57.135550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.135995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.136749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.137211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.268909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:57.276660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3fad5caf-40ff-4d07-b7fb-ccffae101cc3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152774 Aug 02 09:19:57.277307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 775/1565] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:57.672870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:57.673523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:57.680015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.680576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.681572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.682018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.745442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:57.753387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3576fd9-3281-4131-9c97-7c2595280ace tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084533 Aug 02 09:19:57.753976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 791/1566] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:57 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:57.890934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:57.893491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:57.896701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:57.900803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.901377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.902155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.902591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.934095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fba6a82-bdad-4ab4-aba2-25836ec3ddf0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047870 Aug 02 09:19:57.934587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 776/1567] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:58.033151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.035346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:58.041972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.042418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.043188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.043619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.074150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bd571ec4-b25e-4399-8227-a3dcd3ce6b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Aug 02 09:19:58.074721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 792/1568] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:58.084687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.086911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:58.093581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.094282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.095056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.095501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.126837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-646312c1-24bf-449e-8c3b-c5679e96f856 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045852 Aug 02 09:19:58.127424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 777/1569] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:58.299500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.300110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:58.306550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.307001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.307765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.308189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.444370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:58.452043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45a6db23-e0e8-4633-bb54-ed64d4da16a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156581 Aug 02 09:19:58.452661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 793/1570] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:58.774075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.774692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:58.781600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.782055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.782839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.783283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.850765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:58.858657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a5bc40b1-dbe7-4035-aa48-ab50d3a49997 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088348 Aug 02 09:19:58.859254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 778/1571] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:58.946672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.948808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:58.964860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.965351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.966146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.966580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.002773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8a2da721-5bd4-4bdb-8bec-50807497d258 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060056 Aug 02 09:19:59.003556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 794/1572] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:59.088051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:59.090186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:59.097568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.098022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.098816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.099257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.101786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:59.130972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e55d69ce-1f0d-4afc-8f1e-03b57b2dcbfc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Aug 02 09:19:59.131547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 779/1573] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:19:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:59.139626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:59.142545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:59.149075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.149554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.150323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.150759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.180051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f931ebf1-1741-46d2-9ab1-2ec3985a6bcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044589 Aug 02 09:19:59.180621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 795/1574] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:19:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:19:59.473883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:59.474418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:59.480387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.480840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.481636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.482078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.623586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:59.632099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a011bff-1074-49cd-839b-c65c675edee6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162235 Aug 02 09:19:59.632708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 780/1575] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:59.880179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:59.880803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:59.886989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.887440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.888233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.888678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.958648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:59.966384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8d940f42-14be-49ac-865e-3ac877af5005 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090395 Aug 02 09:19:59.966974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 796/1576] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:19:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:00.016228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.018434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.024618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.025070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.025879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.026316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.057871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3c8145ce-c24d-498e-a7bb-fe826f02e553 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Aug 02 09:20:00.058446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 781/1577] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:00.144408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.146582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.153242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.153699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.154485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.154929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.185379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fde6ce1e-f39f-4f74-a37d-0f64d23e522b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 Aug 02 09:20:00.185956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 797/1578] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:00.192566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.194758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.201381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.201829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.203493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.203927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.239751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-df37bea2-f96f-40b0-aec8-7e4a8c5f6664 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051170 Aug 02 09:20:00.240320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 782/1579] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:00.654143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.654781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.661341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.661795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.662579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.663014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.803298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:00.810948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ef1bae79-856c-4407-a026-36ee2c9ea18c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160789 Aug 02 09:20:00.812187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 798/1580] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:00.989965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.990588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.996770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.997267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.998050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.998492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.068946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:01.071012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:01.073007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:01.076797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3abf7420-f028-46aa-bb23-59ea17ce8c17 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091186 Aug 02 09:20:01.077493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 783/1581] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:01.079676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.080129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.080918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.081382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.114912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-59ea5642-09b4-41cf-aca5-08df17b2a265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048431 Aug 02 09:20:01.115505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 799/1582] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:01.197781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:01.199954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:01.208908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.209420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.210206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.210647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.246019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f0723859-7dfe-4fdb-a241-c4f4300961ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052280 Aug 02 09:20:01.246599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 784/1583] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:01.253471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:01.255632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:01.262239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.262687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.263457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.263898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.297364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19c3452f-749d-4694-a471-4cb13345a695 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047655 Aug 02 09:20:01.297965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 800/1584] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:01.834004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:01.834620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:01.840768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.841246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.842036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.842460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.024593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:02.033781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bcf00b77-1810-4bf2-8713-3a1b72a794e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.203731 Aug 02 09:20:02.034817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 785/1585] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:02.099281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:02.099804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:02.105981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.106430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.107202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.107624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.130466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:02.133265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:02.145938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.146386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.147288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.147729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.175197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:02.187283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15cdadb2-586b-48dc-ab9d-e2b8b8e5a0f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063047 Aug 02 09:20:02.187858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 786/1586] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:02.194501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c830024c-340a-4c02-88cc-50d643575a9d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.099199 Aug 02 09:20:02.195100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 801/1587] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:02.258824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:02.261040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:02.268030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.268466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.269280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.269711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.301189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d3d5181a-f6c6-49d8-ba43-0d485ff66db8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046275 Aug 02 09:20:02.301975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 787/1588] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:02.309976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:02.312908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:02.320061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.320604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.321525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:02.321995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:02.357572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ebc11861-30a4-4afa-b322-00f076433528 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051624 Aug 02 09:20:02.358075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 802/1589] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:03.056081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.056700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.063512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.063970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.064756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.065225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.199530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.201803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.208277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.208724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.211119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.211119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.212427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:03.222455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c5aabfc3-fc79-451d-96a3-a7fb8e921adf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169897 Aug 02 09:20:03.223623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 788/1590] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:03.231214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.232211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.242534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.243168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-800b8ce5-d178-48ee-af2d-d03e5565fa09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047900 Aug 02 09:20:03.243311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.243776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 803/1591] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:03.244486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.245256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.314168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.316532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.316987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:03.324275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.324814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.325100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1658459-381d-408f-a376-4e3e0b03551d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.100318 Aug 02 09:20:03.325730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 789/1592] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:03 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:03.325946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.326394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.357241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-77353772-1d0d-4e0c-baa3-8cefbb9ac2f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047353 Aug 02 09:20:03.357843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 804/1593] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:03.370153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.372296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.379760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.380817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.380951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.381423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.412343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9055c21b-8f76-44cd-bfa0-8aee2587a7a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046111 Aug 02 09:20:03.412918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 790/1594] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:04.246846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.247370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.254611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.255055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.255827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.256258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.256525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.258731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.269032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.269780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.270974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.271670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.308611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-df523e71-21cb-4496-a309-136fa7621c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056121 Aug 02 09:20:04.309238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 791/1595] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:04.349592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.350248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.356702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.357155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.358021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.359044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.410008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:04.413487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:04.427528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b6f21a1-d844-4647-a348-2231a83d9f33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.184507 Aug 02 09:20:04.428317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 805/1596] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:04.433976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.438704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.439236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:04.448378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.448932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.449705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b9df1fc-a781-41fb-932c-e6bac83d73a2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.104232 Aug 02 09:20:04.449830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.450224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.450644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 792/1597] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:04.457406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.459816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.467003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.467770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.469538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.470267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.486067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-afcb1552-0fee-4627-9349-aead874a24d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055846 Aug 02 09:20:04.486667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 806/1598] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:04.520984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a65bd24-b1b5-4a70-8c04-452042f00532 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068650 Aug 02 09:20:04.521928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 793/1599] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:05.320777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.323004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.331055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.331502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.332333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.332797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.364995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69550c96-ce85-41c1-82d9-30a3a6b4bb43 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048146 Aug 02 09:20:05.365604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 807/1600] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:05.449947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.450610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.458170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.458620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.459392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.459828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.474263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.474881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.481135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.481602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.482388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.482825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.552602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:05.560495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a2493f37-2830-4edc-8571-3bbe338ea63c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090069 Aug 02 09:20:05.561086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 808/1601] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:05.568491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.570948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.578896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.579343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.580123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.580562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.611331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a4c3a354-343c-444a-8d88-01570c5d4263 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048256 Aug 02 09:20:05.611920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 809/1602] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:05.615782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:05.616829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.619288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.624502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81793d90-018a-4a77-a36e-f9e8a2def25f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.178015 Aug 02 09:20:05.625103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 794/1603] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:05.626590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.626992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.627926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.628362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.659274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a2faf982-20b7-4b6d-8469-9dd7bd300d3a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046274 Aug 02 09:20:05.659868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 810/1604] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:06.377623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:06.379786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:06.385977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.386427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.387202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.387637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.413244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:06.420483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40ed5884-5e82-4098-83f0-6d714c8189c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047333 Aug 02 09:20:06.421721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 795/1605] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:06.582300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:06.582930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:06.589623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.590075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.590845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.591287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.625777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:06.628378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:06.635126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.635604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.636406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.636856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.659282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:06.667176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c425deb4-27ee-4cd9-8d8b-2a7323645ce7 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088802 Aug 02 09:20:06.667753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 811/1606] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:06.670236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-170a9690-e23d-424b-89ad-49e305f30ecd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049086 Aug 02 09:20:06.675417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 796/1607] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:06.675623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:06.675623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:06.676062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:06.678315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:06.680997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.681713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.682698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.683303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.685746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.686246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.687170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.687801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.719850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-58c07efe-503f-4773-b78c-f5cc52b4dee7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047494 Aug 02 09:20:06.720743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 797/1608] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:06.827673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:06.835393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-080797c9-61fa-4b6c-88a5-6c83c6ee54e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166618 Aug 02 09:20:06.835976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 812/1609] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:07.433872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.436225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.443220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.443676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.444460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.444901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.475501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5257aaf3-c077-405d-87e6-6fdc7f00e8fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 02 09:20:07.476092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 798/1610] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:07.683642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.686090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.694786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.695239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.695632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.696200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.696313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.696791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.703947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.704398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.705207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.705643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.729670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c46c460-3712-4998-8a86-d4f67146e530 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050287 Aug 02 09:20:07.730268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 813/1611] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:07.735730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.737952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.744228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.744675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.745481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.745915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.779715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bba3b4ef-e9c5-4760-9320-12262af1b28a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048046 Aug 02 09:20:07.781470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 814/1612] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:07.783581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:07.792175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fdc69ff2-782c-4cb3-b154-c17695bfe67b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.100251 Aug 02 09:20:07.792754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 799/1613] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:07.857827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.859570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.865704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.866154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.866925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.867376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.003927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:08.011411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-23574d6f-c14b-477b-b56a-ea54a4d1957d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157485 Aug 02 09:20:08.011982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 815/1614] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:08.488066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:08.490325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:08.496354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.496885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.497746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.498182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.528155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eadd6497-6cb8-4770-b7ca-b061709b3ec0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Aug 02 09:20:08.528713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 800/1615] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:08.744348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:08.746455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:08.753974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.754418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.755184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.755614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.784781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3bc944dd-67dc-441b-923f-ba9865b63991 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Aug 02 09:20:08.785373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 816/1616] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:08.794788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:08.797004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:08.804497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.804950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.805748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.806193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.812924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:08.813574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:08.819512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.819961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.820723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:08.821194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:08.837234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fdfa6186-bc61-48f0-ae35-9e49d86cd799 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046360 Aug 02 09:20:08.837809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 801/1617] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:08.882559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:08.890770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69e119f5-700e-4c2f-a196-f971e2850b79 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082374 Aug 02 09:20:08.891336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 817/1618] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:08 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:09.033493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.034104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.040257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.040702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.041526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.041960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.185867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:09.194345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc2e5f4f-0795-414e-b351-28d12fdb8c2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.165022 Aug 02 09:20:09.194922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 802/1619] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:09.540126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.542346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.549863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.550315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.551108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.551553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.581565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6afbb052-2801-4810-97ee-a83a071238ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Aug 02 09:20:09.582144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 818/1620] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:09.797394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.799591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.806274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.806727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.807508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.807950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.838715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c481a5d2-b791-4a71-8523-54550994d1dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 Aug 02 09:20:09.839287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 803/1621] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:09.850481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.852656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.859610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.860125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.860961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.861479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.893451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-31630f03-0b1c-45ae-b045-577e636dc84a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046907 Aug 02 09:20:09.894046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 819/1622] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:09.911828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.912438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:09.918763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.919224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.920032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.920453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.990340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:09.998388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd7502c8-ff84-4bc0-8bed-619793154b55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090447 Aug 02 09:20:09.999547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 804/1623] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:10.216084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:10.216608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.223232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.223680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.224447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.224876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.376550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:10.384486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6f225709-2afb-4803-9f94-97ca691ff020 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.172419 Aug 02 09:20:10.385076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 820/1624] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:10.594084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:10.596259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.602576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.603030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.603811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.604255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.635130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8e05a6bb-e6b7-4cdb-8782-1e83b6a93cf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Aug 02 09:20:10.635721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 805/1625] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:10.855374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:10.859322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.866121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.866573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.867356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.867795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.899341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5a1fdbfd-03f8-42d9-a47b-82270910e483 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051435 Aug 02 09:20:10.899911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 821/1626] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:10.906710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:10.908992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.915722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.916177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.916968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:10.917438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:10.950151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13fdbc1a-027f-47fb-b3c6-ae11d5889c5c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048181 Aug 02 09:20:10.950733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 806/1627] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:11.023483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.024252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.030682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.031119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.031885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.032313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.059296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:11.104647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:11.113142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-736235df-380f-4175-be45-9a285b4cbdcb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.096102 Aug 02 09:20:11.113714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 822/1628] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:11.412280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.412893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.419915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.420444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.421797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.422388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.579727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:11.587547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-089564de-828f-4ce9-b4eb-13171c886632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.181180 Aug 02 09:20:11.588327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 807/1629] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:11.650131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.652395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.659846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.660301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.661097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.661569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.698751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56731d1c-9c3a-4229-8bf2-43aa4d0cadc3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052807 Aug 02 09:20:11.699251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 823/1630] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:11.911990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.914239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.922483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.922807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.924138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.924881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.959344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87b2f28d-0acb-4609-8678-b6ceae8acc9c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050856 Aug 02 09:20:11.960384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 808/1631] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:11.963471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.965774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.972555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.973024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.973888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.974320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.005679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2eb803ba-1300-4bcb-a223-82e72c9ef3d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046316 Aug 02 09:20:12.006250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 824/1632] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:12.135601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:12.136219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:12.142857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.143307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.144075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.144513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.206461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:12.214097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-04c68f91-6571-4b9e-b0e8-9d81c422ee7d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082366 Aug 02 09:20:12.214599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 809/1633] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:12 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:12.608821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:12.609475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:12.615643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.616087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.616857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.617326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.711463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:12.713681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:12.722099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.722099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.722099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.722099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.753304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-280dc30f-8042-4050-9f51-e167d6c39bbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Aug 02 09:20:12.756462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:12.761552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 810/1634] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:12.764978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11994816-99bc-4d7b-aa2b-f25f0b3d08eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160029 Aug 02 09:20:12.766086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 825/1635] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:12.972740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:12.974939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:12.981593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.982046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.983327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.984384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.016036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-83891700-05f8-45f0-a657-478a86483021 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047211 Aug 02 09:20:13.016784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 811/1636] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:13.018779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.020982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.028398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.028853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.030172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.030767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.067437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-12a8202b-7822-4f81-abd2-fc5a9dc4d311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052955 Aug 02 09:20:13.068038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 826/1637] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:13.236350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.236872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.242938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.243377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.244134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.244564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.262273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:13.309684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:13.317274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-862d8656-6ac5-46d6-bf53-2183f72a2e95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085410 Aug 02 09:20:13.317881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 812/1638] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:13.774727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.776934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.783588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.784031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.784808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.785266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.786530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.787145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.793350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.793804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.794579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.795020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.818722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d17af8e9-b0d5-4abe-a60c-8165f0dc0b47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048008 Aug 02 09:20:13.819302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 827/1639] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:13.946482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:13.955846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4313531-7479-4482-a5d4-e5bff3c17a8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173039 Aug 02 09:20:13.956457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 813/1640] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:14.028215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.031269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.037805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.038254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.039027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.039458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.070542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf53110a-e538-4720-a954-258c40d54925 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Aug 02 09:20:14.071120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 828/1641] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:14.080071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.082308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.088837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.089324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.090097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.090538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.121830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7357b411-eb0b-430c-b097-7644d83e3b28 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045712 Aug 02 09:20:14.122408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 814/1642] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:14.341634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.343295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.349484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.349942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.350713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.351154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.417704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:14.425762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c8445318-c7a0-45b0-bf2f-7bd2656b7f7b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088222 Aug 02 09:20:14.426349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 829/1643] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:14.831437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.833631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.839766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.840219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.840999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.841459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.875317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81f9497d-fffe-4967-afb4-5e28866879b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Aug 02 09:20:14.875900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 815/1644] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:14.978055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.978768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.985089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.985718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.986756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.987251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.084067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:15.086264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:15.093594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.094047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.094832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.095268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.125670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed27857e-3442-4c20-aa04-8de7bf97b154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Aug 02 09:20:15.126408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:15.126879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 816/1645] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:15.134577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2e8e58e6-8bef-4bc3-8369-80b8215a45e0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160537 Aug 02 09:20:15.134965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:15.135346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 830/1646] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:15.137151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:15.144445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.144884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.145709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.146139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.176993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-780e5308-dca8-4eea-9169-b3261e363247 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046052 Aug 02 09:20:15.177654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 817/1647] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:15.446834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:15.447361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:15.454446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.454905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.455686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.456123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.522866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:15.531003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9e13ed6b-e8cc-4b0f-aec6-4f964942d521 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088113 Aug 02 09:20:15.531589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 831/1648] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:15 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:15.889097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:15.891279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:15.897528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.897979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.898746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.899177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.930794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-53a1d3f1-b37a-4f02-8766-33652c94b6f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Aug 02 09:20:15.931356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 818/1649] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:16.137951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.140693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.147245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.147692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.148458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.148891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.157587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.158355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.164738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.165217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.165986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.166430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.180548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8704d81e-ac68-40ed-ac4e-7b8ed7f0d452 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 02 09:20:16.181146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 832/1650] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:16.190831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.192968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.198930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.199551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.200328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.200768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.231611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34f1928d-fac3-40bb-a47e-d48c772368bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Aug 02 09:20:16.232177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 833/1651] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:16.299949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:16.307447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-507c5fd2-1e05-412a-9da0-928d8a865835 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154634 Aug 02 09:20:16.308014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 819/1652] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:16.552078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.552693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.554582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:16.560220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.560669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.561777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.561974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.624956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:16.632897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d3d17539-3f67-461b-802a-711aa8e0dfff tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084742 Aug 02 09:20:16.633501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 834/1653] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:16.943386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.945602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.953715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.954225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.955119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.955607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.986976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1d0c7ee-ba5f-4a2d-b3c3-5ac79b47c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Aug 02 09:20:16.987547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 820/1654] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:17.192782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:17.194902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:17.201962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.202414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.203184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.203613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.234051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f67e3b4a-4680-47c9-8c10-056aaab3ac37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Aug 02 09:20:17.234621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 835/1655] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:17.244040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:17.246219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:17.253056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.253543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.254352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.254969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.287355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e72ba93a-e1ad-45d6-944a-351dc36d4d94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047240 Aug 02 09:20:17.288042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 821/1656] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:17.329768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:17.330381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:17.336706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.337196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.337978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.338425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.479079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:17.487094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6f11f1fc-b57d-4054-b3b9-78092022408e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162129 Aug 02 09:20:17.487681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 836/1657] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:17.654185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:17.654956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:17.661193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.661646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.662414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.662848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.726194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:17.734116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2092370b-a745-4ded-9069-0193b6617d1b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083615 Aug 02 09:20:17.734357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 822/1658] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:18.000475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:18.002851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:18.009257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.009715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.010496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.010938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.042401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2fa22a54-16d5-451d-bec2-5db7f1ad2394 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Aug 02 09:20:18.043314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 837/1659] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:18.246863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:18.249817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:18.256651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.257130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.257948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.258389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.288653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e46aa3cb-f77a-490e-9e08-44154f1f5c4c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Aug 02 09:20:18.289251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 823/1660] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:18.300609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:18.302772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:18.309304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.309752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.310516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.311002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.340938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e0192a7-3569-40f7-a6ea-41e62f52fe38 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045012 Aug 02 09:20:18.341530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 838/1661] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:18.509726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:18.510259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:18.516590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.517041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.517836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.518271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.657271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:18.664798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81a84cf7-0a24-47bc-bcad-807ee09ddef9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159078 Aug 02 09:20:18.665400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 824/1662] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:18.756068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:18.756687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:18.762896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.763272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.764709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.765292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.769418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:18.828552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:18.836233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-780f3f06-1e67-402e-9481-9dfe22cd6f6b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085056 Aug 02 09:20:18.836814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 839/1663] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:18 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:19.055485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.057626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.064180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.064634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.065435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.065878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.096127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-16e1f602-5467-46bc-98e2-0a410b3d64c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Aug 02 09:20:19.096685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 825/1664] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:19.301292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.303452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.310435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.311423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.312195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.312639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.341644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-06091b21-cde3-4a12-a42a-40ee584d1ff5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Aug 02 09:20:19.342287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 840/1665] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:19.353807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.355967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.358482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:19.363637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.364078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.364864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.365331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.395228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1b0b5c2d-a402-432b-9bba-1e86214d7cef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045308 Aug 02 09:20:19.395778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 826/1666] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:19.687393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.687964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.694251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.694709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.695483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.695924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.832720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:19.840325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-efd2f040-aff3-43a3-a768-1b13fe39d4ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157505 Aug 02 09:20:19.840903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 841/1667] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:19.858438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.859051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.864928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.865406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.866169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.866614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.927478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:19.934989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79761dc4-7d8b-458f-ba00-c13b700beb15 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081124 Aug 02 09:20:19.935706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 827/1668] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:20.109395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:20.111644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:20.117650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.118129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.118874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.119310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.149153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba67764b-3d17-43d0-b40b-f9a865ee723f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Aug 02 09:20:20.149719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 842/1669] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:20.354324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:20.356807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:20.363552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.364016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.364797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.365289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.397203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fd874fb-8ba7-4ab7-aca7-fcea912df7ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046900 Aug 02 09:20:20.397805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 828/1670] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:20.408911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:20.411121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:20.421158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.421608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.422671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.422827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.453349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83133913-ce8f-43b0-8de7-5516bb33e7e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049081 Aug 02 09:20:20.453932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 843/1671] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:20.862822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:20.863439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:20.869435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.869889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.870654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.871088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.874647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:20.955882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:20.956497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:20.962652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.963092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:20.963857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:20.964286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.009343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:21.017427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31129a1a-d730-4af4-a6c1-38448e35ee91 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158386 Aug 02 09:20:21.017974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 829/1672] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:21.027930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:21.035886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-46b968c8-559c-4a05-a07b-688523663ed6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083905 Aug 02 09:20:21.036461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 844/1673] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:20 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:21.161456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:21.163569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:21.169618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.170599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.171386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.171832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.201319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c5e2bf82-4fc8-483c-8278-a624e3b3f8be tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Aug 02 09:20:21.202029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 830/1674] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:21.410885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:21.413387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:21.420663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.421138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.421924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.422368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.453378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d1787f33-67ad-4939-9028-b7f49709b1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046680 Aug 02 09:20:21.453959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 845/1675] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:21.466012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:21.468906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:21.475500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.475944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.476705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.477155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.507453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ce077aaf-0fca-4c14-b114-aa0684462796 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045498 Aug 02 09:20:21.508013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 831/1676] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:22.039194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:22.039858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:22.046132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.046593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.047362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.047803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.056813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:22.057463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:22.064344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.064795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.065614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.066056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.131774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:22.140573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4fc44f91-c4b4-4ad7-88b1-5ac255dcdbae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087533 Aug 02 09:20:22.141171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 832/1677] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:22 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:22.190602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:22.198112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ebf63dc0-c653-435e-8ad0-7bf4a1f0723e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162827 Aug 02 09:20:22.198682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 846/1678] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:22.212968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:22.215158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:22.221369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.221814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.222576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.223004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.252379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4cb5615a-581c-440a-a5e5-b94d3de401f6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Aug 02 09:20:22.252914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 833/1679] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:22.465609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:22.468127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:22.474795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.475245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.476022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.476465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.509268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b22b4863-18a8-4e4c-875d-a43faa701c4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Aug 02 09:20:22.510106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 847/1680] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:22.519918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:22.522259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:22.528988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.530259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.531043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.531526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.563522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15ab4e08-3a43-45b3-97a2-5108a0cc8d4e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047582 Aug 02 09:20:22.564092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 834/1681] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:23.161655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.162182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.168236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.168679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.169473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.170072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.220646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.221296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.227327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.227781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.228555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.229000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.232357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:23.240149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-841ae16d-dc59-445f-ab9a-4ed4b0a0bab5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082445 Aug 02 09:20:23.240735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 848/1682] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:23.264659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.267151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.273565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.274018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.274814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.275249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.316242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3f9317aa-1d1d-45d8-b747-3e7ae6ddb4ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056047 Aug 02 09:20:23.316826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 849/1683] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:23.367970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:23.375527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7d7d1f00-aa4b-4bf2-b63e-cf09c353755e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159556 Aug 02 09:20:23.376357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 835/1684] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:23.522201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.524355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.531160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.531617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.532397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.532838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.562794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6237b999-5989-431c-bdac-e64509b62979 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Aug 02 09:20:23.563366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 850/1685] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:23.575935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.578840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.585365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.585821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.586592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.587032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.616263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-761bb4eb-4869-44b4-bafc-7e4c8d49f030 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044247 Aug 02 09:20:23.616829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 836/1686] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:24.263216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:24.263892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.270238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.270692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.271468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.271904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.329495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:24.331695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.337916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.338070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:24.338373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.339154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.339593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.346581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4c0769fe-b14b-45b1-a9a1-1e5f3d03a37b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087217 Aug 02 09:20:24.347161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 851/1687] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:24 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:24.371188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f5e4a5e9-f86d-4f45-bd9c-07b64c46a5a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Aug 02 09:20:24.371756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 837/1688] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:24.398335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:24.398949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.405677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.406129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.406903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.407344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.544109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:24.552209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-236629ec-a97c-417c-af39-6eb47607f727 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157737 Aug 02 09:20:24.552788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 852/1689] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:24.575243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:24.577806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.584268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.584719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.585529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.585958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.616560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8dd843af-ff4c-49c2-9e4d-42fa19d7bbb2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045394 Aug 02 09:20:24.617129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 838/1690] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:24.628333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:24.630527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.636598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.637050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.637857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.638295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.669208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f84d2454-490d-4309-9cc4-faebfed0f952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045117 Aug 02 09:20:24.670280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 853/1691] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:25.368452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:25.369090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:25.375270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.375714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.376722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.377185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.383903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:25.386108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:25.393144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.393599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.394384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.394828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.425807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2f195a4c-84df-43d3-88e1-bdad0aff3d8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 Aug 02 09:20:25.426389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 854/1692] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:25.439547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:25.446971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-765cba1e-5739-4f6a-bf5e-b932c219c2bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082428 Aug 02 09:20:25.447523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 839/1693] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:25 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:25.573612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:25.574238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:25.581414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.581870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.582645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.583085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.628719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:25.630834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:25.637382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.637839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.639120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.639565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.671575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0b37c464-71c1-4065-a8ce-faa42f20d32f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Aug 02 09:20:25.672160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 840/1694] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:25.682192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:25.684701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:25.690863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.691323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.692101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.692538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.722956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:25.723475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c689ebfe-fd16-4472-9cc4-557a20a59ade tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045430 Aug 02 09:20:25.724260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 841/1695] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:25.726620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:25.731901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-053c0210-97e6-4a29-8729-9d9df59835e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162211 Aug 02 09:20:25.732486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 855/1696] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:26.438351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:26.440502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:26.446720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.447165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.447931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.448362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.468391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:26.469011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:26.475486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.475940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.476722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.477194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.477503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed708fa5-27c5-4f2b-8c39-2984048612af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Aug 02 09:20:26.478387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 842/1697] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:26.540377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:26.549390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8ff6fc7-f53f-4387-ab57-81c801b076eb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085011 Aug 02 09:20:26.549979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 856/1698] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:26 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:26.684862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:26.687102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:26.693691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.694139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.695122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.695565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.725586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0032d80c-dc64-43a3-bfec-d4f00045f1e6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Aug 02 09:20:26.726148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 843/1699] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:26.736668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:26.738838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:26.744833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.745321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.746084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.746528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.752977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:26.753671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:26.759625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.760271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.761054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:26.761515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.777006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-462d8692-0216-4899-9c24-15b4d510025e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045016 Aug 02 09:20:26.777621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 857/1700] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:26.902210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:26.911573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-67f78294-6d38-4ef0-8d65-d48367adce0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162585 Aug 02 09:20:26.912147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 844/1701] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:27.490716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:27.492893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:27.501223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.501674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.502447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.502885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.533451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8c36094c-e2bb-4ad3-837d-5f18ddacf745 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Aug 02 09:20:27.534016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 858/1702] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:27.569523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:27.570159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:27.576901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.577518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.578288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.578728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.640453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:27.642703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:27.649418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-34dc10fd-7758-44a0-b903-64a2ed5ea230 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083695 Aug 02 09:20:27.649997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 845/1703] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:27.738730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:27.740914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:27.746946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.747389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.748781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.749238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.777859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30c33dd0-b324-4ee0-94d2-ee6a971ba12f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Aug 02 09:20:27.778440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 859/1704] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:27.790360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:27.792525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:27.799643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.800092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.800854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.801327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.830786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a2f09c57-1a65-4705-af12-1154713ad056 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044373 Aug 02 09:20:27.831369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 846/1705] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:27.933103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:27.933747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:27.940579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.941025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.941810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.942241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.074275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:28.081922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9dd9e97a-a3dd-4fde-a961-15eda950464e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152660 Aug 02 09:20:28.082498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 860/1706] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:28.545023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:28.547251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:28.553313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.553749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.554517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.554956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.584277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f23a5736-8651-4cee-a902-cd690992fde5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Aug 02 09:20:28.584842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 847/1707] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:28.669588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:28.670216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:28.676837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.677326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.678100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.678543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.743903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:28.752961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b467e915-f378-4cc5-b6d9-6137e5c5c7b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087205 Aug 02 09:20:28.754402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 861/1708] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:28 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:28.793613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:28.797346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:28.805475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.805914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.806691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.807136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.843234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:28.844832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-86acc4aa-3f63-4708-a446-59fb7666d0d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058461 Aug 02 09:20:28.845743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 848/1709] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:28.845974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:28.853044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.853509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.854294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.854735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.885064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7721f2c-9d90-48bc-80f5-a6ab4653c7f6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046695 Aug 02 09:20:28.885664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 862/1710] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:29.103906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.104438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.110461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.110912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.111675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.112117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.244604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:29.253147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dd69e8f4-83a5-4e7f-9797-68ecc11dcfee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153385 Aug 02 09:20:29.253717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 849/1711] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:29.598361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.600566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.606842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.607877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.608665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.609124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.638699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fbce198b-a131-455e-a0dd-5d695ac219e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Aug 02 09:20:29.639267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 863/1712] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:29.774124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.774735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.781276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.781721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.782478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.782910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.847681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:29.855525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-64a4cdd4-19ec-42a8-adbe-5c9ce77e3f2d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085136 Aug 02 09:20:29.856019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 850/1713] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:29.856906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.859912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.866594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.867084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.867862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.868430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.898805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.900103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a383369b-0b67-4236-a02a-89a388ad6648 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 Aug 02 09:20:29.900676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 864/1714] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:29.901134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.908927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.909408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.910187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.910626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.942079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6795e460-69ed-4c25-b140-968825e22658 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047316 Aug 02 09:20:29.942654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 851/1715] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:30.274867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:30.275476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:30.282171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.282611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.283375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.283805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.423489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:30.433677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-919cda75-6401-4a01-9ea2-fb509117d7a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162666 Aug 02 09:20:30.434271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 865/1716] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:30.651204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:30.653339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:30.660203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.660883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.661465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.661906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.692400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-de1e66cb-ac6e-42ff-b813-3c846dc08ab3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 02 09:20:30.692963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 852/1717] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:30.877033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:30.877702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:30.884212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.884660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.885468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.885910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.914076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:30.916321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:30.922873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.923329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.924111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.924550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.954105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:30.959549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b9c6693d-7377-4321-a2cf-2bf5975abe95 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049543 Aug 02 09:20:30.960825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 853/1718] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:30.964763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:30.966439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb61222e-ede8-47d5-8205-1d56b05d8d5e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093536 Aug 02 09:20:30.967625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:30.968218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 866/1719] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:30.974720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.977223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:30.977223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:30.977223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.007151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f3a90274-823c-4146-8fc8-9ed7e0bce8a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045966 Aug 02 09:20:31.008006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 854/1720] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:31.455325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:31.455946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:31.462061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.462515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.463287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.463726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.597183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:31.604658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdbf23de-f39d-4a7b-9200-2aa25467fdfd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153318 Aug 02 09:20:31.605270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 867/1721] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:31.705593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:31.707672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:31.714174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.714619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.715414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.715850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.746120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b965252-56b6-4a76-a160-0266be81e8ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Aug 02 09:20:31.746672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 855/1722] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:31.972598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:31.974730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:31.981259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.981711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.983389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.983842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.991174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:31.991792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:31.997772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.998197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:31.998967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:31.999404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.013736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f725ae9e-9258-4586-bb4a-a3172a5f4606 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Aug 02 09:20:32.014531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 868/1723] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:32.020228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:32.022399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:32.028217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.029236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.030222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.030673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.060895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56e3cf7b-f976-4b73-aae5-b0767be9ec05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044275 Aug 02 09:20:32.061480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 869/1724] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:32.065014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:32.072626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-051ca207-9e6f-41cc-9f55-72f2c134cc59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085288 Aug 02 09:20:32.073205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 856/1725] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:31 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:32.628491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:32.629105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:32.635659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.636107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.636930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.637409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.760170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:32.762570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:32.770435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.770897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.771760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.772192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.779450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:32.786866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0e542c1d-f1e6-4883-9902-bea794127269 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162621 Aug 02 09:20:32.787438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 870/1726] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:32.802471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b36e5313-8952-411a-9505-a908f1091add tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046454 Aug 02 09:20:32.803023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 857/1727] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:33.026536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:33.028719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:33.035266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.035713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.036471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.036902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.066787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0ae71a05-599a-4ffb-9124-9723033b1529 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Aug 02 09:20:33.067358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 871/1728] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:33.073578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:33.075862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:33.081786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.082234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.082992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.083439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.093349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:33.093968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:33.100284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.100739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.101585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.102023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.113311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7071e397-b4fd-46f8-87ef-2e6409ad397a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043739 Aug 02 09:20:33.113873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 858/1729] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:33.121567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:33.174011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:33.181467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-93c35cf2-01cc-4ec6-ac75-8314d5b0b8a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092382 Aug 02 09:20:33.182043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 872/1730] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:33.809361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:33.810013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:33.814920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:33.816791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.817284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:33.817415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.818066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.818511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.823649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.824103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.824890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:33.825354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:33.856467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-524065fd-ee03-47e1-897f-a40b0d64498a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 02 09:20:33.857476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 873/1731] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:33.955698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:33.963810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3a184762-a4c7-44f8-a171-b10f3131d859 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158820 Aug 02 09:20:33.964381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 859/1732] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:34.079691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:34.081850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:34.088590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.089038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.089841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.090278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.121469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83010049-84f9-444c-9d85-313eaaede835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Aug 02 09:20:34.122036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 874/1733] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:34.126739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:34.128918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:34.134896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.135394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.136119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.136558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.165918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1352bc5d-8369-4cac-8b16-602db839791d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044090 Aug 02 09:20:34.166480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 860/1734] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:34.203567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:34.204191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:34.210311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.210766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.211540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.211975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.274098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:34.281675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e9589919-b35e-4e33-856c-5f2819029b82 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082962 Aug 02 09:20:34.282245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 875/1735] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:34 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:34.868839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:34.871068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:34.878612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.879065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.879831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.880269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.909382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f91c34a3-5f51-4b43-9673-b6e3560b8cc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Aug 02 09:20:34.909949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 861/1736] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:34.987298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:34.987915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:34.994033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.994478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:34.995239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:34.995673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.134633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:35.136773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:35.143448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.143894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.144655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.145089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.145492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:35.153002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-91411b28-f07b-4dcb-a295-a43a2c146d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169660 Aug 02 09:20:35.154255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 876/1737] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:35.159822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:35.175308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8821e5cb-d77f-498b-b92d-1e69d20c5f08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Aug 02 09:20:35.175860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 862/1738] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:35.178535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:35.180682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:35.187003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.187457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.188230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.188669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.219111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e94b05c1-c0a9-4cc5-a014-5910c756c5a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044487 Aug 02 09:20:35.219670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 877/1739] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:35.303946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:35.304566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:35.310580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.311036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.312217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.312768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.374887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:35.382789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-093c0be7-3b81-410a-891e-fd061d8ea788 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082982 Aug 02 09:20:35.383354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 863/1740] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:35 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:35.922246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:35.924440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:35.930567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.931020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.931795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:35.932237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:35.961465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8279972d-2a77-4a03-bda5-42058aae62d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 02 09:20:35.962029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 878/1741] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:36.175892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:36.176423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:36.182877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.183327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.184093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.184527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.187992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:36.190156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:36.196451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.196896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.197693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.198125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.227344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d307f423-4ba0-4c36-9f10-51c3f2792155 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Aug 02 09:20:36.228113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 879/1742] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:36.233340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:36.235482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:36.241421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.241864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.242624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.243052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.273005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aab5c701-c9b6-46f4-83a6-875758680e7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044049 Aug 02 09:20:36.273610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 880/1743] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:36.319303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:36.326904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ba3b0aaf-c781-406e-8dce-af0378ab5248 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155002 Aug 02 09:20:36.327467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 864/1744] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:36.404500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:36.405326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:36.411315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.411754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.412513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.412946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.473711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:36.481184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-86e79cdd-dbf6-4d04-9523-19d7352a39a9 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081315 Aug 02 09:20:36.482366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 881/1745] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:36.973872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:36.976071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:36.982407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.982857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:36.983621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:36.984060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.013801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7473f0b4-c506-49d1-9d9f-616f0b991d6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Aug 02 09:20:37.014455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 865/1746] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:37.240094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:37.242187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:37.249809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.250259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.251291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.251724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.281817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c8a59c0e-8ae6-4431-9ca0-6c18217edc2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045767 Aug 02 09:20:37.282393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 882/1747] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:37.285764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:37.287926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:37.294878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.295335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.296100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.296539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.326752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79c74912-e3d4-4e64-aa73-2f839abf88ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043733 Aug 02 09:20:37.327313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 866/1748] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:37.347895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:37.348513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:37.354508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.354956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.355751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.356188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.493472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:37.502449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19b92afa-0151-418e-88a5-cf031878bb6d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158348 Aug 02 09:20:37.503039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 883/1749] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:37.503166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:37.503730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:37.509731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.510197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.510966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:37.511405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:37.572700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:37.580270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-69efa21f-3164-4961-97e5-9673ae287d95 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081413 Aug 02 09:20:37.580837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 867/1750] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:37 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:38.025350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:38.027526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:38.030000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:38.035249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.035705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.036482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.036922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.068460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3846e8e0-4348-45e8-8b6a-6d08e2224b5e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Aug 02 09:20:38.069032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 884/1751] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:38.294361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:38.296552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:38.303061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.303514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.304281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.304720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.336129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6898c3b-1a89-4e98-ac39-56821ebda27d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Aug 02 09:20:38.336692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 868/1752] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:38.339213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:38.342031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:38.348456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.348917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.349715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.350161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.378851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39a537b9-8451-49f7-be20-a5716d220e8d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043632 Aug 02 09:20:38.379417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 885/1753] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:38.523379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:38.523997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:38.530115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.530570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.531336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.531776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.601003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:38.601683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:38.608119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.608347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.609179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:38.609573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:38.666707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:38.673062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:38.674622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c19fc257-437f-4001-a615-9ef22bd231cb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155045 Aug 02 09:20:38.675203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 869/1754] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:38.680594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e913de64-607f-4fc9-9a28-76d419f13aa3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083528 Aug 02 09:20:38.681178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 886/1755] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:38 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:39.080291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:39.082497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:39.088809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.089289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.090057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.090486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.119645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2cbbf516-b2d7-493c-92a7-55656e87be0e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Aug 02 09:20:39.120194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 870/1756] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:39.348460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:39.350642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:39.358077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.358511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.359271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.359699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.388467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5980b8ac-aa5c-4b39-be0c-e9b7c64b7599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 02 09:20:39.389018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 887/1757] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:39.391034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:39.393211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:39.399851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.400295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.401053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.401509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.430627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73f7493d-fb6a-47ad-9990-652fd066f08a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043809 Aug 02 09:20:39.431177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 871/1758] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:39.697171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:39.697691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:39.701188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:39.702005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:39.704353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.704798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.705587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.706017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.707863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.708317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.709085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:39.709551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:39.773016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:39.781249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1973610b-9eb0-474c-8bde-44aac23c23bc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084461 Aug 02 09:20:39.781829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 872/1759] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:39.837497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:39.845766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83488ea8-584f-4324-8587-3da4a71a7ffe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152614 Aug 02 09:20:39.846340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 888/1760] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:40.132279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:40.134468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:40.141240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.141689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.142448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.142887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.172130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6ba15945-20af-4715-9523-429a665f7390 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Aug 02 09:20:40.172689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 873/1761] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:40.400621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:40.408191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:40.410345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.410801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.411584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.412024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.415855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:40.443066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:40.444571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83501fa8-8dac-4119-9453-1be2a5cc1a2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048007 Aug 02 09:20:40.445199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 889/1762] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:40.445341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:40.451896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.452345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.453144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.453601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.484637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b81b4f82-25e2-4555-a124-b10730c665b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045485 Aug 02 09:20:40.485253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 874/1763] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:40.801983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:40.802602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:40.808625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.809079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.809910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.810423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.867664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:40.868407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:40.874107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:40.875209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.876023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.876819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:40.877300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:40.882172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ea5cb4e1-9c2f-494a-83b6-e658accbd2a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084135 Aug 02 09:20:40.883002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 890/1764] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:40 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:41.011215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:41.019576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c77ed207-44cb-4b34-9e7e-c814bf5eee27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155653 Aug 02 09:20:41.020168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 875/1765] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:41.184126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:41.186463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:41.192782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.193271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.194059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.194506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.225845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2896bae5-32fc-48d9-9c81-48490d54e522 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Aug 02 09:20:41.226384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 891/1766] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:41.457931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:41.460008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:41.462376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:41.468712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.469188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.469969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.470404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.497928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:41.499748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-951d8957-b225-49f9-b286-69db44dfb32d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Aug 02 09:20:41.500080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:41.500310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 876/1767] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:41.507226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.507677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.508481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.508920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.538030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-799c67ba-6d7b-4a6c-a894-7bc9bd540744 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044782 Aug 02 09:20:41.538590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 892/1768] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:41.902783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:41.903467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:41.909684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.910300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.911112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:41.911551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:41.974119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:41.982300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-caccc7d5-5744-4b1b-b027-de754fc0eb84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083401 Aug 02 09:20:41.982863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 877/1769] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:41 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:42.041691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:42.042307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:42.048852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.049343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.050114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.050557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.182215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:42.190596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a33e14f4-edf6-4595-96ca-714eca6792a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152821 Aug 02 09:20:42.191172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 893/1770] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:42.237991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:42.240149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:42.246130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.246588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.247976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.248420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.276946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3bb9ab5b-3b58-474f-90ce-f734a365676b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Aug 02 09:20:42.277530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 878/1771] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:42.513287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:42.515511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:42.521971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.522420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.523186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.523623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.551055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:42.553217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:42.553590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-86498521-a318-4bf2-9347-7f69288257fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Aug 02 09:20:42.554141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 894/1772] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:42.559622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.560231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.561016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:42.561536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:42.563908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:42.590545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-367c4e5b-90e2-40e9-850b-6f07d33e3d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043426 Aug 02 09:20:42.591747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 879/1773] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:43.003732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:43.004352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:43.010500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.010955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.011720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.012161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.073012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:43.081620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c8ba2b09-f7e0-4fde-9ca4-59994ffe8958 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082124 Aug 02 09:20:43.082197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 895/1774] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:43.211839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:43.212457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:43.218997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.219440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.220210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.220654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.290395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:43.292626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:43.299199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.299651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.300439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.300874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.332143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-235db419-5fbb-488d-a7eb-7d7e0c5cdfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045612 Aug 02 09:20:43.332641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 896/1775] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:43.355332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:43.362852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1b804a4-faff-4d61-8436-60a13747332e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154917 Aug 02 09:20:43.363420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 880/1776] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:43.566088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:43.568222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:43.574602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.575086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.575862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.576284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.602687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:43.604752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f598bf06-5dde-4a91-b565-fef6b8a2e977 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Aug 02 09:20:43.604929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:43.605416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 897/1777] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:43.612478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.612930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.613783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:43.614230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:43.647524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8b7bde74-41f4-40a3-8c72-ed8afa126b2b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048769 Aug 02 09:20:43.648136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 881/1778] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:44.102377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:44.103110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:44.109998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.110450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.111222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.111661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.173152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:44.180624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8bcda4a8-4590-43d7-89fc-1f2b094e5e4d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082196 Aug 02 09:20:44.181217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 898/1779] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:44.345411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:44.347603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:44.353795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.354253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.355029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.355470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.384597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ecd81969-6100-4ac0-9d42-9fb4ce3b0bea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 02 09:20:44.384815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:44.385184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 882/1780] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:44.385346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:44.391953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.392399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.393190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.393626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.530647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:44.538249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5a29c5fa-0002-4dde-99b7-5cf1e708cf36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157948 Aug 02 09:20:44.538832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 899/1781] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:44.618004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:44.620162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:44.627383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.627841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.628609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.629047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.658912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5bb61378-ccb2-4e4f-8799-075d6847a86e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Aug 02 09:20:44.659509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 883/1782] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:44.660366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:44.662533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:44.669054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.669538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.670357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:44.670793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:44.699541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0b31b123-29c9-484e-8311-56068d34ae4f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043477 Aug 02 09:20:44.700978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 900/1783] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:45.201662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:45.202191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:45.208286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.208742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.209566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.210006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.272758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:45.281087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6756b5b6-777e-4763-9982-39ab9e8de3f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083863 Aug 02 09:20:45.281667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 884/1784] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:45 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:45.397740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:45.399921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:45.406570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.407021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.407796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.408234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.437577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-768fccaa-a9ff-4fef-94f4-0d486a0ae6df tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Aug 02 09:20:45.438141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 901/1785] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:45.559549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:45.560192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:45.566159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.566607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.567367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.567800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.671818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:45.674490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:45.680936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.681413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.682189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.682625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.705283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:45.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ac805e23-a4ed-4ab9-9150-0cdd29aa408c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157166 Aug 02 09:20:45.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 885/1786] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:45.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:45.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:45.731317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db96957e-3c30-4cf5-a42e-2323093dbbe2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058350 Aug 02 09:20:45.731317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 902/1787] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:45.731510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.731510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.731510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:45.731510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:45.759637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-819441f0-e7fb-4828-b53f-17897c8092b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Aug 02 09:20:45.760190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 886/1788] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:46.302709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:46.303326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:46.310001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.310450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.311212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.311648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.372947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:46.381176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2d50ecf3-82e9-40ee-90f5-d19bce2717ce tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082411 Aug 02 09:20:46.381761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 903/1789] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:46.450093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:46.452313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:46.458344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.458794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.459553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.459989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.489012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-446c6719-3a1c-4982-bc25-2129d7f6e970 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Aug 02 09:20:46.489604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 887/1790] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:46.738610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:46.740833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:46.741618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:46.742235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:46.748086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.748453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.749076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.749506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.749614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.750049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.750313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.751015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.782640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db127a90-2b71-4860-81ee-05fd8fa71622 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047996 Aug 02 09:20:46.783222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 904/1791] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:46.788329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:46.790484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:46.799424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.799873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.800649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:46.801083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:46.828404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:46.833737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f4811748-7667-49a4-95f9-bcc27f4a8ab0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049129 Aug 02 09:20:46.834318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 905/1792] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:46.885495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:46.893295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-750c533e-d258-4a98-b4b9-0c78368051ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155460 Aug 02 09:20:46.893870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 888/1793] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:47.402425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:47.403786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:47.410172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.410623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.411386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.411822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.474180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:47.481906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-36a310d6-d868-4842-a4c9-a73622cdba60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083587 Aug 02 09:20:47.482466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 906/1794] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:47 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:47.501775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:47.504013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:47.510041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.510494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.511277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.511714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.540714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15f7b6d4-966a-4661-9f8f-c562e95ae322 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Aug 02 09:20:47.541296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 889/1795] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:47.794470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:47.796637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:47.803304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.803755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.804527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.804965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.834314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6896a3e5-d7fe-46e0-a20f-b9deba60acad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Aug 02 09:20:47.834847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 907/1796] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:47.845616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:47.847826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:47.854275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.854728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.855490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.855925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.885811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c22a6e0-2151-4070-9b0c-e027ae77a0ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044219 Aug 02 09:20:47.886365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 890/1797] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:47.915074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:47.915684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:47.922432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.922825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:47.923592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:47.924029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.057917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:48.066313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0c57603b-f73c-49f3-ab25-ed715ebfa80c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155279 Aug 02 09:20:48.066887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 908/1798] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:48.503106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:48.503725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:48.509809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.510286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.511123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.511582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.553300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:48.555588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:48.561868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.562324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.563112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.563554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.576154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:48.585307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b15de260-981e-4d68-92fd-51374b4340c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086294 Aug 02 09:20:48.585896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 891/1799] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:48.595089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e8dce81-3937-4a21-9fc0-a4c866f73426 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 02 09:20:48.595878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 909/1800] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:48.846953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:48.849032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:48.855488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.855947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.856999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.857464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.886138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62c812db-caa4-4563-8c47-297f62f0b31d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043286 Aug 02 09:20:48.886688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 892/1801] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:48.899223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:48.901422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:48.908780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.909269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.910057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:48.910496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:48.940284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8cbbafde-fa13-4d35-8274-61dabf86cf94 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045003 Aug 02 09:20:48.940861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 910/1802] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:49.086759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:49.087379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:49.093558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.094011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.094777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.095214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.225672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:49.233103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e757a51c-e71b-4162-82bd-f96ba8f45a68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.150292 Aug 02 09:20:49.233708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 893/1803] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:49 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:49.607020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:49.607635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:49.608015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:49.610309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:49.613758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.614212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.614980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.615416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.616111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.616555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.617332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.617768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.647425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a429f6c9-ed8c-456f-99ad-2f92ab82719e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Aug 02 09:20:49.647988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 894/1804] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:49.677012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:49.686985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18f5e550-c59e-4789-91b6-4be7a2cf064c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083381 Aug 02 09:20:49.686985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 911/1805] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:49.899147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:49.901252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:49.908071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.908525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.909334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.909778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.935055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:49.940644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-354adcd7-0fd8-401f-a906-ad1511b3d123 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Aug 02 09:20:49.941235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 895/1806] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:49.952550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:49.954728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:49.961278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.961733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.962501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:49.962941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:49.991327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7678c8b1-bc32-4c97-aa78-1a903fdb3f2c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043470 Aug 02 09:20:49.991888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 912/1807] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:50.255498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.256116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.262056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.262590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.263357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.263798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.397705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:50.405398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73475cd2-c8dc-4e34-8ae2-ff810e139105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154035 Aug 02 09:20:50.405963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 896/1808] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:50.660364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.662470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.669349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.669885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.670653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.671097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.699879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f03f3f07-71ab-4264-b974-443d50872a9d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 02 09:20:50.700450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 913/1809] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:50.712769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.713423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.721233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.721680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.722438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.722870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.792900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:50.802044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e1a5696-2351-4b8e-88cb-c39ac4487266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093060 Aug 02 09:20:50.802612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 897/1810] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:50 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:50.953570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.956732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.964119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.964574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.966029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.966503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.001760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32552477-4c39-4a9e-a0f7-6ffc027da4fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053204 Aug 02 09:20:51.002333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 914/1811] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:51.006248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:51.008510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:51.015875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.016328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.017128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.017572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.055808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a919bc2b-774c-416a-8af9-dcc43567f3ee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055289 Aug 02 09:20:51.056385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 898/1812] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:51.427238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:51.428068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:51.436619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.437096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.437891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.438334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.574022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:51.581831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7ddf192-104e-4b28-9149-0aa9bd1aecf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158569 Aug 02 09:20:51.582413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 915/1813] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:51.713088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:51.715305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:51.722092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.722544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.723317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.723760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.754734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4b011e08-63de-40e8-b340-1531a1df73f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Aug 02 09:20:51.755323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 899/1814] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:51.825455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:51.826076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:51.832149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.832597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.833392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:51.833831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:51.900465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:51.909937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a626f07d-8e85-4a6e-bcec-f84ef9230687 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088082 Aug 02 09:20:51.910182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 916/1815] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:52.014317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:52.016493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:52.022988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.023434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.024201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.024668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.055170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e3c8f47a-dca3-453e-b209-8b6bf189512a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Aug 02 09:20:52.055725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 900/1816] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:52.068092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:52.070385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:52.077322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.077901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.078691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.079134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.110427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e000010f-dee0-4ca1-b2be-a1f25ae296a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046304 Aug 02 09:20:52.111003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 917/1817] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:52.603669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:52.604314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:52.610235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.610690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.611459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.611903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.742627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:52.750975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fbe4922f-ed1c-47d9-8905-1ae0b618cbe2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151012 Aug 02 09:20:52.751534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 901/1818] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:52.767731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:52.769910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:52.775938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.776400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.777188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.777635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.805658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1fb20ecf-98b9-4381-968e-17f8a0e1eb2c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041973 Aug 02 09:20:52.806215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 918/1819] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:52.929971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:52.930590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:52.937610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.938059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:52.938829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:52.939269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.002626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:53.010151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-92dad27d-0edf-47cf-baf7-aab3c8c568a8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084184 Aug 02 09:20:53.010710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 902/1820] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:53.067544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.069912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.076911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.077386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.078168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.078610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.107104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f81c624c-e2b6-47db-8cb3-b8a2fa8841b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Aug 02 09:20:53.107664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 919/1821] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:53.123159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.125367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.133499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.133957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.134739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.135179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.166899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f4308766-e9aa-44e1-831d-ec32257bb069 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048636 Aug 02 09:20:53.167809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 903/1822] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:53.772027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.772647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.779550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.780027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.780796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.781267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.818574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.820733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.827016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.827457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.828229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.828657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.859457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3c7242dc-9c15-4485-96b4-f93ccc512f59 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Aug 02 09:20:53.860078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 904/1823] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:53.913777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:53.921884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0206cbf-59de-44f9-b470-d44f4399b916 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153776 Aug 02 09:20:53.922470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 920/1824] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:54.033805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.034329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.040302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.040751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.041547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.042007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.103844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:54.111372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9629974a-00c9-4dae-878e-33b2d1e2fb55 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081518 Aug 02 09:20:54.111933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 905/1825] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:54.119334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.121542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.128342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.128803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.129604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.130045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.160094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c675438-acd6-4714-b663-b9120d78747b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Aug 02 09:20:54.160664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 921/1826] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:54.180060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.182363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.189583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.190039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.190811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.191247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.223191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a2dbaf9-cc01-4bcb-9fe5-6fe775bede2f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047114 Aug 02 09:20:54.223755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 906/1827] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:54.872208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.874412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.880907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.881396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.882183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.882620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.900854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:54.916607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3eaa7b1e-0da1-4aa0-b039-bdcd7b7e86a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048952 Aug 02 09:20:54.917454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 922/1828] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:54.942861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.943585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.949643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.950168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.950959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.951396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.132278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:55.132912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:55.140101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.140549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.141401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.141822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.162184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:55.171194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a533b473-824f-4582-8d24-44179604b7a5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.232231 Aug 02 09:20:55.180675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 907/1829] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:55.185718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:55.187976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:55.194433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.194935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.195701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.196129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.226565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aa7c928c-b6b5-4e6d-bdf1-783ce0e7dd94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053747 Aug 02 09:20:55.227131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 908/1830] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:55.236553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:55.239018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:55.244968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.245451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.246221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.247426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.257789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:55.265442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-43391528-f4f2-4da5-96fa-297c98282a71 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.137185 Aug 02 09:20:55.266021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 923/1831] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:55.279143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e37f11e-c670-431f-aa90-d5348e37b7a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045240 Aug 02 09:20:55.279699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 909/1832] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:55.931180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:55.933395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:55.942023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.942470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.943253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:55.943693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.973717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-351eb2d0-9dae-4678-a315-69aac66b0f49 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Aug 02 09:20:55.974287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 924/1833] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:56.192653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.193241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:56.200110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.200672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.201484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.201922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.239168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.241364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:56.248367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.248812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.249609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.250048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.281554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b11e26c-9a6b-42da-bea0-3c1a9d132629 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Aug 02 09:20:56.282141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 925/1834] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:56.286714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.287330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:56.293791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.294244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.295014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.295453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.339401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:56.349324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ffaf5b2a-5f7c-400a-b91d-abd7658b281c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160507 Aug 02 09:20:56.350092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 910/1835] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:56.354884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.358744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:56.366127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.366702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.367553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.367996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.368267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:56.377128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9767d3d9-209c-47f8-b7a0-3879beb5bd8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093966 Aug 02 09:20:56.377724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 926/1836] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:56.398559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-217eeaf0-6380-423a-8e93-bf5b3910a264 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047526 Aug 02 09:20:56.399123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 911/1837] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:56.986271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.988479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:56.994994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.995435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.996228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.996706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.028479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dcf7cda-8fa8-4242-8eb5-f307a04944b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Aug 02 09:20:57.029073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 927/1838] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:57.294001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:57.296309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:57.302755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.303205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.303966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.304401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.318827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:57.336529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9bd19eca-bcd2-43e7-8a9f-90dc524dedd2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047095 Aug 02 09:20:57.337091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 912/1839] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:57.372083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:57.372701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:57.379481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.379929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.380695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.381146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.397827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:57.398432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:57.404976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.405530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.406295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.406729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.470281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:57.478014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d0235be7-7a28-43d0-acb1-c75aaad2da46 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084003 Aug 02 09:20:57.478589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 913/1840] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:57 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:57.493174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:57.495338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:57.502296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.502742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.503509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.503939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.519315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:57.526882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f1381f0f-1e88-4eae-a824-d4e8ed891cc0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159339 Aug 02 09:20:57.528543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 928/1841] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:57.534640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2da23738-335a-4e24-9180-2e1e231c41b6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055012 Aug 02 09:20:57.535204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 914/1842] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:20:58.040107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:58.042329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:58.049154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.049611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.050409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.050877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.081100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-48ce9c1d-d150-461a-9837-6cf5cdd43877 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Aug 02 09:20:58.081625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 929/1843] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:58.349490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:58.351603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:58.358418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.358872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.359640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.360083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.390828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d6cc146d-4946-4b9a-81e8-ea2b2c49b060 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Aug 02 09:20:58.391399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 915/1844] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:58.500161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:58.501032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:58.507540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.507989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.508752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.509220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.547595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:58.549792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:58.555945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.556399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.557192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.557634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.571487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:58.578940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-68c1fb3c-8a90-414a-81a4-a402badcc9c4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083569 Aug 02 09:20:58.579513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 930/1845] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:58.583902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:58.584506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:58.587699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5cd1de4b-c92f-44ce-af0b-6b4949908493 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044730 Aug 02 09:20:58.588411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 916/1846] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:58.590357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.590794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.591568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:58.591998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:58.725720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:58.734070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-581c2f29-c4b5-4ae4-a3f7-5eb67d4cc1c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153518 Aug 02 09:20:58.734755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 931/1847] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:59.094496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:59.096647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:59.102848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.103304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.104076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.104515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.134254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fe3e34c1-e5c0-4382-a090-b4fa32894f88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Aug 02 09:20:59.134814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 917/1848] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:59.403235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:59.405399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:59.411461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.411904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.412671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.413129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.442938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5114820-4270-479b-ad0c-93bd796486a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Aug 02 09:20:59.443513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 932/1849] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:20:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:59.599897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:59.600485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:59.600854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:59.602170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:59.607110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.607566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.608345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.608789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.609342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.609797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.610569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.611007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.641129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd8f68c8-59a7-4fc0-b2d3-969d25f71ddc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045056 Aug 02 09:20:59.641736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 933/1850] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:20:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:20:59.674409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:59.681957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-78e50dd3-b886-447a-8e37-6968af891ccb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085989 Aug 02 09:20:59.682524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 918/1851] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:59.756346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:59.756955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:59.758796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:59.764626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.765175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.765978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:59.766420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:59.897328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:59.905222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-71132cb6-8805-46a2-8ba7-26c9fed53b9b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152735 Aug 02 09:20:59.905808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 934/1852] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:20:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:00.147272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:00.149429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:00.155722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.156181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.156988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.157462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.188004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dbaccbb1-a134-405b-a196-9c9f1b120d0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 Aug 02 09:21:00.188599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 919/1853] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:00.455487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:00.457579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:00.463889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.464222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.465868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.466515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.496972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-186951bf-1c68-466c-82f6-6de6e0cb096e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045052 Aug 02 09:21:00.497601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 935/1854] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:00.653843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:00.656083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:00.662448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.662894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.663671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.664102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.696424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-72df081b-f606-4fab-baf6-e171f79325ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047440 Aug 02 09:21:00.697018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 920/1855] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:00.703594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:00.704205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:00.711113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.711494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.712264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.712692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.776958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:00.785568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ccec25bc-5ff2-49bb-9a30-20e713bbc1da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086397 Aug 02 09:21:00.786161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 936/1856] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:00 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:00.926407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:00.927027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:00.933030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.933520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:00.934291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:00.934731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.067957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:01.076428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66071879-90cc-4f23-89d7-08c9269bbe75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153924 Aug 02 09:21:01.077000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 921/1857] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:01.202027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:01.204526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:01.210854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.211302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.212071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.212509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.241377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-121cf053-ff09-48ed-94db-3e3cc366de87 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 02 09:21:01.241942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 937/1858] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:01.509846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:01.512378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:01.518457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.518912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.519693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.520119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.549649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8b75cfda-0b06-4815-bf28-4f9211960990 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Aug 02 09:21:01.550209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 922/1859] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:01.709723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:01.711816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:01.718595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.719041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.719806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.720239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.750126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-653654b7-325d-4739-a336-340e7caa4548 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044566 Aug 02 09:21:01.750948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 938/1860] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:01.806289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:01.806923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:01.814002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.814481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.815234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:01.815676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:01.879117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:01.886796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6ebda8d9-49a8-43df-9715-d8e94ff1f8c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084383 Aug 02 09:21:01.887368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 923/1861] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:01 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:02.097894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:02.098612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:02.104791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.106008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.107048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.107494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.111596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:02.243188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:02.253852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:02.254036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cf4f3020-a407-476e-b585-c6d24b2d0105 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159859 Aug 02 09:21:02.254562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 939/1862] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:02.256194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:02.263559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.264013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.264797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.265263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.295839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc6e589c-844e-47f0-b931-381352c68655 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Aug 02 09:21:02.296587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 924/1863] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:02.562306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:02.564396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:02.573027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.573510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.574496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.575027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.606135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-744223db-10b9-4f66-b95f-7aff480cc93f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047343 Aug 02 09:21:02.606685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 940/1864] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:02.763029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:02.765208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:02.771216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.771677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.772444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.772878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.803659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eaced69f-eea8-47a7-a9c8-7f293a569f05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044774 Aug 02 09:21:02.804213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 925/1865] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:02.908128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:02.908658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:02.915248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.915702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.916471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:02.916906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:02.979869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:02.987763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-61a544ba-db2b-48ad-b946-c2073484b7c8 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083655 Aug 02 09:21:02.988338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 941/1866] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:03.275593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:03.276185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:03.279149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:03.284828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.284955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.285695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.286129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.307953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:03.310294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:03.316249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.316697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.317494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.317941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.348001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-acb01385-bee7-47e4-af07-2798c5ead1eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 02 09:21:03.348581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 942/1867] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:03.420872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:03.428320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-577c7a02-c339-4d61-8d2a-424db7160d2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.156561 Aug 02 09:21:03.428889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 926/1868] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:03.618243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:03.620319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:03.626912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.627362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.628129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.628566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.658215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5bcd7a1-0842-4a35-a83f-f21ce9c9a193 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Aug 02 09:21:03.658768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 943/1869] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:03.816014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:03.818180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:03.824696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.825188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.826030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:03.826459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:03.854610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a2e9fc0b-61d3-4c43-8f03-ac0f4f43f868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042637 Aug 02 09:21:03.855351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 927/1870] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:04.009091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:04.009726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:04.016938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.017432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.018210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.018650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.080198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:04.087809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3921a03f-8e5d-41fa-88ab-9bae66634528 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082633 Aug 02 09:21:04.088376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 944/1871] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:04.360003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:04.362207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:04.368682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.369156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.369930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.370655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.400436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5fe01870-ef02-468f-ae5d-d550b69c2278 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 02 09:21:04.400984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 928/1872] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:04.449479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:04.450096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:04.456177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.456640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.457437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.457875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.589204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:04.597008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-307d75a9-c69c-400f-9a60-6ef6b17002c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151503 Aug 02 09:21:04.597618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 945/1873] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:04.670866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:04.672971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:04.678853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.679294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.680043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.680470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.684865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:04.709193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b51b6241-2e44-4305-9bfb-24b0720be578 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Aug 02 09:21:04.709746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 929/1874] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:04.867143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:04.869372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:04.876137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.876590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.877396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:04.877836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:04.907134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d4f12954-d450-4d83-9a2a-1aee5cf22d30 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044004 Aug 02 09:21:04.907720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 946/1875] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:05.108583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:05.109263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:05.115217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.115659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.116410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.116840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.177131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:05.184591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eedc9efa-ee07-4e0f-a08e-e1be5655e068 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080663 Aug 02 09:21:05.185170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 930/1876] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:05 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:05.412851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:05.415184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:05.421508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.421955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.422717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.423151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.451827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8df84abe-b366-499f-910b-0beb6eb32f24 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Aug 02 09:21:05.452293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 947/1877] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:05.619188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:05.619804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:05.627227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.627668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.628424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.628857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.721817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:05.724103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:05.730412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.730978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.731753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.732194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.759241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:05.763183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4a560555-ee96-4305-8464-10f9f316248b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Aug 02 09:21:05.763769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 948/1878] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:05.767351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3849fec6-20bf-46d6-9498-4c423efde7a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151996 Aug 02 09:21:05.767921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 931/1879] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:05.920109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:05.922343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:05.928593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.929046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.929942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:05.930386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:05.959691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1265d8fd-ffce-4f9b-9316-73aceaedfcea tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044253 Aug 02 09:21:05.960191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 949/1880] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:06.206308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:06.206922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:06.212943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.213372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.214128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.215652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.280333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:06.287792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7f4b3842-c855-4c03-a03b-32e601e6e64f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085412 Aug 02 09:21:06.288351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 932/1881] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:06.464143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:06.466442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:06.473068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.473552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.474337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.474776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.504517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-012f4b35-2d3c-4348-b854-c40d6433ee23 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Aug 02 09:21:06.505083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 950/1882] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:06.775711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:06.778554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:06.785494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.785941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.786698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.787130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.787628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:06.788412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:06.794544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.794991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.795763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.796203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.815812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a09f620e-e830-46c1-9852-137eb250d728 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044108 Aug 02 09:21:06.816368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 933/1883] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:06.925537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:06.933211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5234e14e-fc31-4196-96ef-f9172861c1e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.149397 Aug 02 09:21:06.933790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 951/1884] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:06.971963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:06.974196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:06.980218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.981074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:06.981919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:06.982356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.012094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1a34b807-d2a9-4d0a-882a-fc515b1da6bc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043417 Aug 02 09:21:07.012630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 934/1885] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:07.308669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:07.309504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:07.315460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.315900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.316653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.317091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.377555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:07.384942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e9faf840-9b52-4117-a1e8-b40d29dc985d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.080698 Aug 02 09:21:07.385550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 952/1886] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:07.516931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:07.519174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:07.525221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.525677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.526440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.526888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.555749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88c4ad4c-b77e-46ff-a195-28fce2208593 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Aug 02 09:21:07.556304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 935/1887] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:07.829208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:07.831388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:07.837876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.838328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.839085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.840113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.868749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4f04137a-9265-4d0b-b962-832eaedb9e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Aug 02 09:21:07.869325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 953/1888] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:07.955474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:07.956121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:07.962835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.963286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:07.964057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:07.964501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.024536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:08.026743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:08.033306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.033754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.034523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.034960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.065724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b5ef32c-a3a4-4cc2-a526-e6fd2e0373e7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045160 Aug 02 09:21:08.066301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 954/1889] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:21:08.096473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:08.103949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-563eb521-b436-4a74-9328-a62f1037c7d5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152511 Aug 02 09:21:08.104512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 936/1890] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:08.406530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:08.407066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:08.413071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.413622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.414389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.414829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.477892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:08.481957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:08.486950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db49a8ea-cb44-416a-9219-30f47354ba59 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084425 Aug 02 09:21:08.487525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 955/1891] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:08 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:08.568743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:08.570935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:08.577039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.577526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.578352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.578794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.607765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3c2c061f-7319-448e-a1a8-7f0a8eaa084f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Aug 02 09:21:08.608313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 937/1892] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:08.882863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:08.885029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:08.892290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.892745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.893558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.893999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.927903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ad80e6eb-fbe9-4b7f-8d6b-04dd750b0c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049351 Aug 02 09:21:08.928485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 956/1893] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:09.078894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.080962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.087561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.088048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.088826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.089312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.118635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e07a9518-9818-4d42-a0b2-f142a96799b3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043827 Aug 02 09:21:09.119234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 938/1894] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:09.125880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.126525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.132476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.132928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.133734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.134178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.272302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:09.281460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3790cc50-c293-49ea-b5d9-04b06172e9b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159669 Aug 02 09:21:09.282646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 957/1895] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:09.507835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.508449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.514925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.515372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.516134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.516571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.578717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:09.586310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-89b8765f-d36d-471c-8caf-e1779baae7f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082344 Aug 02 09:21:09.586875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 939/1896] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:09.618952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.621184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.627586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.628041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.628817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.629300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.659490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56130a83-5055-454c-b9ec-ae1d6db54fec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Aug 02 09:21:09.660059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 958/1897] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:09.940811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.943022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.950036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.950822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.950935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.951449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.986784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d9479bc0-9443-465c-b6a0-6983bd5e06cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050378 Aug 02 09:21:09.987355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 940/1898] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:10.132448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:10.134641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:10.141965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.142420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.143201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.143645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.174266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6fc0b1b6-be6f-41de-9257-2c2d608e8f6d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045985 Aug 02 09:21:10.174755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 959/1899] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:10.303102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:10.303707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:10.310791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.311231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.311986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.312422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.368389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:21:10.368641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:21:10.450806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:10.458372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b4e1d410-3776-414b-b452-83db6ce2b198 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159139 Aug 02 09:21:10.458985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 941/1900] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:10.607887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:10.608490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:10.614506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.614949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.615702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.616133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.672152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:10.674356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:10.677605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:10.680824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.681399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.682240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.682746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.685945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8dcb14d-8e42-433e-bd7d-49c687d3e363 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082574 Aug 02 09:21:10.686526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 960/1901] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:10 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:10.713875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bd23fb8c-6e98-4738-80ad-d430bad1577e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046150 Aug 02 09:21:10.714388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 942/1902] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:10.999018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.001428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.007717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.008169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.008944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.009408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.040379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b65c4ac4-3735-496f-bd3f-8e7f97f3df6e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Aug 02 09:21:11.040974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 961/1903] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:11.187039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.189246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.195277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.195730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.196492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.196929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.227099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26702a92-e30c-4bf5-951c-b7e38b6860ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044373 Aug 02 09:21:11.227655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 943/1904] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:11.479541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.481164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.487852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.488300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.489068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.489531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.631136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:11.638705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5148804-27c9-41d7-aa54-a501b41e89fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163055 Aug 02 09:21:11.639285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 962/1905] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:11.706307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.707021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.713701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.714152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.715145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.715584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.725275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.727550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.734081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.735363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.736421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.736864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.770386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5258932b-20b9-42bb-b9c9-0268fbc4791c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049184 Aug 02 09:21:11.770987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 963/1906] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:11.787644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:11.795912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8aab0988-ff67-45c6-b6ed-f79096838821 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093457 Aug 02 09:21:11.796493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 944/1907] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:11 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:12.053805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.055966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.062735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.063192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.063971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.064406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.092957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c49c2229-d127-4798-b282-4e9cf4ba1410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Aug 02 09:21:12.093552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 964/1908] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:12.303778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.306218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.312555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.313004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.313805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.314245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.341064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:12.348127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1c0e9b91-acca-4fa9-90a3-96048727da23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112041 Aug 02 09:21:12.348721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 945/1909] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:12.660000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.660564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.667188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.668144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.668923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.669395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.782947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.785299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.791800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.792266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.793627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.794108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.800619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:12.809682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-86b29b9d-c3a7-48a8-bed9-3fa24e2ca422 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152400 Aug 02 09:21:12.810309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 965/1910] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:12.817187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.817805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.826313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3a3dbd67-feb5-4e81-819e-b65c7b9bb26d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047286 Aug 02 09:21:12.827061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 946/1911] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:12.830300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.830845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.832410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.833249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.896261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:12.903926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4e28a234-5916-423c-a14b-403d47b156da tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090477 Aug 02 09:21:12.904506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 966/1912] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:13.106746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:13.108944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:13.114923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.115375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.116139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.116573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.146681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6dac014d-9f7a-4d35-9ea9-588721a429fb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Aug 02 09:21:13.147235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 947/1913] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:13.360246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:13.362465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:13.368536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.368990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.369807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.370249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.400199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7c9094e2-aef9-4991-9299-82e73047a974 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044009 Aug 02 09:21:13.400972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 967/1914] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:21:13.830118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:13.830733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:13.837461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.837916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.838698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.839140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.839319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:13.841539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:13.847897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.848396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.849182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.849618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.880279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-174d9103-fe83-4f95-b9c9-782156ec438b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Aug 02 09:21:13.880846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 968/1915] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:13.924780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:13.925445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:13.931417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.931878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.932654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:13.933737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.984530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:13.992280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7d02e384-89c2-420b-a285-d07bf86e67b1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166019 Aug 02 09:21:13.993045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 948/1916] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:13.998981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:14.006870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-49d781c3-e80d-43e9-978a-bebb02bbbcbf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085956 Aug 02 09:21:14.007443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 969/1917] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:13 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:14.159369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:14.161479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:14.168007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.168522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.169317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.169749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.197697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4b3125de-4539-47a7-ad6b-7a81a942f567 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Aug 02 09:21:14.198251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 949/1918] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:14.413996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:14.416085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:14.422788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.423232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.423991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.424419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.452852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9770749-701a-4537-8f95-1ce5382f9750 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043006 Aug 02 09:21:14.453542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 970/1919] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:14.892321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:14.894508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:14.900958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.901461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.902789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.903231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.933432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-412bc110-b234-447e-96df-262a53e09013 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Aug 02 09:21:14.934008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 950/1920] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:15.015026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:15.015645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:15.022449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.022902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.023683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.024121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.028357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:15.028973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:15.034919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.035373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.036143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.036581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.100081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:15.108024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d4fa5c18-ca52-4051-9086-126da59d9e14 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084248 Aug 02 09:21:15.108612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 951/1921] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:15 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:15.157084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:15.164671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-daa502eb-b523-46b4-ad8b-79f7df6eb769 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.153829 Aug 02 09:21:15.165271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 971/1922] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:15.273372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:15.275607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:15.282873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.283321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.284093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.284529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.315879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17f64f45-9fe7-49bd-97b3-f5fafdc632ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109729 Aug 02 09:21:15.316430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 952/1923] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:15.466814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:15.469005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:15.475268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.475726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.476501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.476941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.494285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:15.508346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e1be2901-4e6c-41e9-8ffc-a4a7967b3009 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046863 Aug 02 09:21:15.508913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 972/1924] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:16.009918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:16.012829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:16.018814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.019263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.020033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.020471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.049681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-087e3580-d983-4043-8e21-55a4b3f600f5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107898 Aug 02 09:21:16.050243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 953/1925] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:16.129134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:16.129766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:16.136418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.136885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.137691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.138132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.187593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:16.188151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:16.194182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.194623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.195383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.195815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.201354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:16.209009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d1affb73-f53e-4a5f-a0c0-b18aca6249d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083983 Aug 02 09:21:16.209628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 973/1926] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:16 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:16.327568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:16.329641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:16.329788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:16.336036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.336484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.337292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.337448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dca240af-f834-4098-9788-a46dbf5df46e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.154589 Aug 02 09:21:16.337727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.338037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 954/1927] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:16.367615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ef2e0278-db45-4abe-85f3-70d4a081f976 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Aug 02 09:21:16.368178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 974/1928] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:16.521567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:16.523797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:16.530517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.530961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.531739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.532173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.562303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fc9eb8e-b925-4b3b-a8d5-254be85d075b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044674 Aug 02 09:21:16.563079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 955/1929] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:17.062913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:17.065135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:17.071291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.071742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.072507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.072941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.102958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd3aac7f-fa76-4661-b9ec-66b792e94a18 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Aug 02 09:21:17.103536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 975/1930] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:17.230934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:17.231474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:17.237990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.238451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.239215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.239655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.301767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:17.309303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5451206e-bd51-4fd3-acd1-31df8183a2de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082881 Aug 02 09:21:17.309882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 956/1931] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:17 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:17.359904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:17.360525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:17.366633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.367086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.367855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.368302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.380117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:17.382317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:17.388512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.388964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.389793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.390240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.422997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e7df6300-2d96-4853-889c-66a5746068e4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Aug 02 09:21:17.423576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 957/1932] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:17.502640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:17.510355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bac8e89b-e515-4432-af6d-90942d4075f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155483 Aug 02 09:21:17.510926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 976/1933] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:17.575115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:17.577474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:17.583830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.584305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.585063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.585519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.614962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-577cc22b-23f6-4f70-8fa8-7bee4ff6b96b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044530 Aug 02 09:21:17.615542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 958/1934] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:18.117088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:18.119279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:18.126228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.126677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.127439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.127892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.156911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6cda80f4-4f60-4875-8445-7318aa870222 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 02 09:21:18.157532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 977/1935] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:18.329679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:18.330300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:18.337462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.338001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.338879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.339330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.403568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:18.411386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e46843c-463b-4b0e-8326-189cf10db50c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085560 Aug 02 09:21:18.411949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 959/1936] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:18 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:18.436214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:18.438423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:18.445081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.445562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.446332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.446768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.479837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7de4e9c4-8350-4436-a4e0-9c727ff8ecf1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048518 Aug 02 09:21:18.480515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 978/1937] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:18.532246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:18.532886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:18.539120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.539566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.540344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.540784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.627922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:18.630166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:18.637196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.637709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.638496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.638936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.669978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a1d22041-282b-4032-ad9c-38e4f409acad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046298 Aug 02 09:21:18.674473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 979/1938] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:21:18.683877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:18.691602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-54e1abf3-ed93-42ec-8545-9d71a85b7718 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163281 Aug 02 09:21:18.692176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 960/1939] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:19.170117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:19.172378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:19.178517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.178979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.179762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.180203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.214121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18bf87dc-653d-4494-8063-4c0f69aa0fca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048525 Aug 02 09:21:19.215288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 980/1940] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:19.432109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:19.432640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:19.440496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.440973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.441775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.442214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.494662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:19.497015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:19.503825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.505566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.505566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.505566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.508872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:19.517420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6260854d-8e9a-42eb-8d0d-e0235166fbc1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089243 Aug 02 09:21:19.518010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 961/1941] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:19 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:19.544504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a864b869-fc27-4b0d-8ff4-2a68f2afb1fe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054502 Aug 02 09:21:19.545093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 981/1942] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:19.682884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:19.684967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:19.691131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.691584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.692365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.692802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.706796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:19.717659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:19.718766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:19.723967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d47bb62f-d014-433b-a83d-783aad818b81 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045347 Aug 02 09:21:19.724528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 962/1943] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:19.727172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.727619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.728393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.728818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.865842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:19.874332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6f448a1-1e85-426e-9239-a14ebba458ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163958 Aug 02 09:21:19.874917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 982/1944] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:20.227485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:20.229691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:20.235777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.236234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.237010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.237482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.268644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e9fff7b0-1d61-4336-82c8-5ed49ae5bed3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045143 Aug 02 09:21:20.269243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 963/1945] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:20.541339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:20.541963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:20.549236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.549687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.550473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.550914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.557198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:20.560181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:20.566984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.567434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.568254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.568691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.600007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4920eaf1-1434-40a0-b80b-0f0b8f885a82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Aug 02 09:21:20.600794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 964/1946] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:20.618314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:20.627348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f49328f9-9dd1-4ba2-a8e7-640c5eabda8b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090168 Aug 02 09:21:20.627947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 983/1947] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:20 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:20.737289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:20.739438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:20.745728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.746183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.747511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.747948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.780553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d2433251-2d10-478b-a733-d9e0d99aa38a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047503 Aug 02 09:21:20.781138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 965/1948] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:20.896209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:20.896745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:20.898674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:20.904914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.905392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.906184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.906624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.046520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:21.054301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0cfecd1d-b0ec-47da-90c1-7a593a7404f4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162177 Aug 02 09:21:21.054911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 984/1949] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:21.282189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:21.284385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:21.290423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.290868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.291634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.292063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.324588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b9c3ca9-fd67-410b-9c97-b82754cd507b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046114 Aug 02 09:21:21.325367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 966/1950] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:21.612578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:21.614766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:21.622653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.623101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.623887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.624324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.648470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:21.649089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:21.657010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.657562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.657700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dc3cf32a-55f0-4aff-b5ff-9d10980a0058 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049283 Aug 02 09:21:21.658297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 985/1951] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:21.658439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.658936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.722481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:21.730209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-46c3c59a-d452-4766-838a-474ce3a31a1d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085543 Aug 02 09:21:21.730734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 967/1952] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:21 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:21.793838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:21.796015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:21.802344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.802801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.803582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.804022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.835708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b100cfa0-3106-4038-a317-6ce801e2ae97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045902 Aug 02 09:21:21.836294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 986/1953] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:22.076191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:22.076804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:22.083211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.083656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.084429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.084924 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.226481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:22.234876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6a98a8d5-f288-486e-8cb7-5cc944c989ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163131 Aug 02 09:21:22.235454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 968/1954] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:22.337474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:22.339718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:22.346004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.346456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.347240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.347677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.380120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e2bfda6d-9431-4cdc-a9a7-869c49cf4b71 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Aug 02 09:21:22.380731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 987/1955] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:22.672140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:22.674372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:22.681132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.681583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.682346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.682778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.712865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c7877079-ab08-45df-a4df-87042828ff9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045618 Aug 02 09:21:22.713553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 969/1956] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:22.751188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:22.751827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:22.758497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.758946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.759735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.760169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.826975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:22.835298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-51875b89-defe-4678-8889-3312deb4afb2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088278 Aug 02 09:21:22.835903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 988/1957] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:22 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:22.849312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:22.851791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:22.859791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.860232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.861011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:22.861468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.894543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1263dd0-4398-4d42-ad9b-80eee57af1ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049375 Aug 02 09:21:22.895118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 970/1958] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:23.256961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:23.257605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:23.264848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.265325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.266105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.266535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.270730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:23.392690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:23.395015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:23.401926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.401926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.402817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.403456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.406505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:23.414164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0d1d4ecd-baa5-46a3-a355-f8a2263263e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161042 Aug 02 09:21:23.414758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 989/1959] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:23.434454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-97671ddf-6452-41e1-8686-7d4245ef5217 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Aug 02 09:21:23.435032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 971/1960] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:23.728368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:23.731075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:23.737162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.737620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.738389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.738822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.769232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8e72ba6-2118-47cc-8c58-3677dc87db7e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044954 Aug 02 09:21:23.769955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 990/1961] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:23.858439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:23.859268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:23.867476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.867950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.869062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.869575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.907981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:23.910227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:23.918104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.918874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.919667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:23.920112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:23.941714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:23.950255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7c20925b-e68f-45b4-9465-feee16ebe2b3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.096975 Aug 02 09:21:23.950840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 972/1962] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:23 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:23.952306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0bd7c02c-66b2-4fd5-891e-0ee2316bbd1f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048576 Aug 02 09:21:23.952907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 991/1963] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:21:24.437595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:24.438212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:24.444450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.444896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.445773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.446209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.447020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:24.449208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:24.455396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.455839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.456607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.457039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.500498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-43243c36-7e4a-4370-b2ac-026137bc355c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057673 Aug 02 09:21:24.501597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 992/1964] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:24.589655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:24.597285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b647ec26-c268-4323-8785-944a574e1293 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164723 Aug 02 09:21:24.597860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 973/1965] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:24.782214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:24.784371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:24.791055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.791498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.792308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.793583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.822919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a38938fc-6475-4486-878b-cac5dc4128ac tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Aug 02 09:21:24.823501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 993/1966] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:24.965461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:24.967327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:24.974612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.975064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.975868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.976291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.981721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:24.982396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:24.988774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.989251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:24.990035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:24.990470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.008529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-be50d1f2-d463-48e1-9b29-caa50512c5d4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047948 Aug 02 09:21:25.009635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 974/1967] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:25.057558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:25.065720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e184946f-72eb-45dc-88b9-95e01c153233 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088809 Aug 02 09:21:25.066318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 994/1968] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:24 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:25.514437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:25.516672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:25.522739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:25.523194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.523971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:25.524411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.556237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f7f23c3-2c69-49c6-9174-bd0f3cb5e6aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Aug 02 09:21:25.556814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 975/1969] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:25.619856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:25.620731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:25.627477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:25.628042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.628835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:25.629303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.773051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:25.781932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6c042528-0ddb-4bf5-b504-e4cdc878dcae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.165949 Aug 02 09:21:25.782536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 995/1970] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:25.838011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:25.840803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:25.842742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:25.848078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:25.848572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.849394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:25.849838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:25.880609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0cd2b41e-cd8e-4fdb-839b-36fcd5186c45 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Aug 02 09:21:25.881196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 976/1971] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:26.021412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:26.023494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:26.031300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.031815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.032659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.033188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.063577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c7ee1c3-8e84-4da9-85ee-4e8e1263154d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046359 Aug 02 09:21:26.064173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 996/1972] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:26.086973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:26.087584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:26.095067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.095504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.096271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.096710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.163383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:26.171351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f945bfca-a44d-42b2-a369-7f026500e16e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088340 Aug 02 09:21:26.171942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 977/1973] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:26 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:26.570549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:26.574862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:26.580869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.581357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.582144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.582591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.614328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3880881-6d32-409c-9992-5ac7ded37d48 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Aug 02 09:21:26.614923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 997/1974] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:26.805463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:26.806243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:26.813394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.813842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.814631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.815072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.893992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:26.896177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:26.905857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.906381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.907183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:26.907625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:26.940412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ed503389-1d6c-4e0f-ac10-aa103528ca76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050394 Aug 02 09:21:26.941165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 998/1975] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:26.958008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:26.966529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-341ad316-6880-45cf-82df-ec77913492cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166254 Aug 02 09:21:26.967138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 978/1976] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:27.077291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:27.079383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:27.085611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.086059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.086836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.087268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.117335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6ab8da5-3b5e-4fbc-a119-b058227459cd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045096 Aug 02 09:21:27.117907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 999/1977] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:27.193067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:27.193713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:27.201757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.202220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.203000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.203429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.206261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:27.268233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:27.275818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f567573-d645-426d-b7d8-a36b8dd2d0e1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086656 Aug 02 09:21:27.276581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 979/1978] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:27.627799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:27.630150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:27.636833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.637317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.638101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.638539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.669790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0c984693-5a96-4ebc-a0af-73ebdb680e72 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Aug 02 09:21:27.670377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1000/1979] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:27.952681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:27.955110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:27.961595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.962057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.962835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.963276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.988817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:27.989475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:27.996167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.996387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a5b607d-7b8d-4231-a41b-12f4993cf21d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Aug 02 09:21:27.997020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:27.997220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 980/1980] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:27.997579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:27.998078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.131177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:28.132274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:28.133389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:28.140779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d3fa7fd-f356-45c7-850c-7cd4bbde2d38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.155749 Aug 02 09:21:28.141416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1001/1981] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:28.142872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:28.143425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.144336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:28.144864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.175721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6dd6e645-6620-469e-bc34-d78f2858e430 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048867 Aug 02 09:21:28.176289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 981/1982] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:21:28.296685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:28.297320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:28.303441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:28.303888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.304715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:28.305171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.374853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:28.382758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-38587e72-3feb-475e-b883-b5cbcb33d42f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090707 Aug 02 09:21:28.383335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1002/1983] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:28 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:28.681843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:28.684173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:28.691042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:28.691526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.692312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:28.692787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:28.723405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a360702e-4c9a-4c35-b917-73a5277a07d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Aug 02 09:21:28.723980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 982/1984] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:29.012750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:29.014971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:29.022009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.022009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.024389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.024389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.056535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ebe0dc5d-d82f-41a4-b8c8-b0ac0ce599cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048435 Aug 02 09:21:29.057130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1003/1985] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:29.162295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:29.163029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:29.169511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.169967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.170741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.171188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.189034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:29.191304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:29.197459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.197906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.199370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.199850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.233505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6eb471d6-0063-494a-a941-cb9374e79b3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048433 Aug 02 09:21:29.234083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1004/1986] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:29.314332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:29.322050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cfcb6baa-7715-46b1-a8e8-9ee03a6f34fe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163626 Aug 02 09:21:29.322618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 983/1987] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:29.403509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:29.404125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:29.410268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.410714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.411491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.411927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.475792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:29.479325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:29.484410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f5267df7-c2fb-46a5-9093-5926c7b270a5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084806 Aug 02 09:21:29.485003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1005/1988] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:29 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:29.624595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:21:29.624881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:21:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:21:29.735873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:29.738137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:29.744844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.745418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.746309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:29.746753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:29.780369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc66f5b2-771e-4b61-833d-28f8b9a67621 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048454 Aug 02 09:21:29.780956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 984/1989] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:30.069593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:30.071881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:30.079393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.079837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.080608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.081058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.111664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0f7b5bbe-5e7b-4ca5-9750-ee8f56d85583 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Aug 02 09:21:30.112236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1006/1990] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:30.246503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:30.249255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:30.255622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.256065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.256830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.257298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.288471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a14b01ff-6785-4f67-ac6d-c93e40e3cfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046147 Aug 02 09:21:30.289041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 985/1991] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:30.344004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:30.344623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:30.350861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.351313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.352097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.352543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.503807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:30.509281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:30.509898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:30.512483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8ff42009-5827-48a4-9c19-f4258fac4e07 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.172537 Aug 02 09:21:30.513085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1007/1992] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:30.517342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.517803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.518574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.519003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.581197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:30.588829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8652ff61-fddb-49c0-938b-7a26f2c72d62 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083399 Aug 02 09:21:30.590199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 986/1993] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:30.792198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:30.794484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:30.800696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.801182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.801966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:30.802400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:30.833543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f46aaf78-25e4-44fd-9d45-0a557a16efbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Aug 02 09:21:30.834151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1008/1994] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:31.126525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:31.128698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:31.134903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.135355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.136183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.137357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.167883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98d17519-687f-4729-9e18-0d74f0398df4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Aug 02 09:21:31.168480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 987/1995] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:31.301301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:31.303439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:31.310745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.311189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.311962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.312398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.343341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1138e0ee-15a7-4dcd-a0bb-f2bc6b9a5cd8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046054 Aug 02 09:21:31.343932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1009/1996] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:31.535248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:31.535865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:31.543056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.543526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.544322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.544771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.613414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:31.614040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:31.620200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.621362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.622142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.622570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.682097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:31.689938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:31.691324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a77ade87-6637-4d46-bff9-cc8251a6ad68 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159942 Aug 02 09:21:31.692114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 988/1997] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:31.697964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c7934ffc-5ce3-4e04-b858-cf17b16f4495 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089741 Aug 02 09:21:31.698584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1010/1998] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:31 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:31.846670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:31.848928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:31.855728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.856187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.856979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:31.857475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:31.887720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c315b4d4-b719-4743-8277-7f74d57f377d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Aug 02 09:21:31.888311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 989/1999] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:32.181638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:32.185026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:32.192685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.193227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.194021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.194460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.227010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-140e1d37-e813-4dd6-8789-6bc3f95147a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050615 Aug 02 09:21:32.227596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1011/2000] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:32.356129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:32.358272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:32.364501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.364951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.365767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.366203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.397133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e35b4c4-6ab1-4731-819d-ee7694d4285d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045529 Aug 02 09:21:32.397705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 990/2001] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:21:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:32.712832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:32.713513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:32.718914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:32.719581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:32.720354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.720798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.721602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.722029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.726070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.726520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.727301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.727743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.797622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:32.805792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-27748836-f34e-42e4-8d66-93ea22de73cf tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090969 Aug 02 09:21:32.806384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 991/2002] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:32 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:32.872600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:32.881057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-58901638-d841-45dd-96e2-706419e22514 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.172368 Aug 02 09:21:32.881682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1012/2003] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:32.900147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:32.902569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:32.910106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.910550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.911340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:32.911783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:32.943536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73611807-eaca-44c5-b149-e9eaa9d2d8b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Aug 02 09:21:32.944157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 992/2004] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:33.239688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:33.241880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:33.249751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.250202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.251263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.251699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.283041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d7883efb-4369-4241-8545-1091a86ad657 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Aug 02 09:21:33.283635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1013/2005] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:33.410979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:33.413025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:33.420267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.420721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.421541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.421985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.524331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15dc6032-a53a-4042-94a8-3b8cdb6bcfda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/action" status: 200 len: 37877 microversion: 2.20 time: 0.117446 Aug 02 09:21:33.524997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 993/2006] 10.222.0.100 () {62 vars in 1324 bytes} [Tue Aug 2 09:21:33 2022] POST /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d/action => generated 37877 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:21:33.827896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:33.828486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:33.835289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.835741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.836526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.836964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.904388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:33.906459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:33.907120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:33.914219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.914824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.915163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2fc57c46-652d-4d84-a9c6-17c3ffdd5503 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091718 Aug 02 09:21:33.915806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.916255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.917075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1014/2007] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:33.956477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:33.958659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:33.965688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.966126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.966904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:33.967341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:33.999776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f6df3f2a-129e-4df4-a25c-3eafb4141533 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Aug 02 09:21:34.000468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1015/2008] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:34.295289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:34.297911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:34.304047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:34.304500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:34.305319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:34.305767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:34.312899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:34.321024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7a9284f7-2390-4190-bd96-b1b08e800800 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.419898 Aug 02 09:21:34.321645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 994/2009] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:34.338404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-819b7171-c633-49be-9500-9f3a75d26176 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047109 Aug 02 09:21:34.339145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1016/2010] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:34.937399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:34.938019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:34.944575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:34.945027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:34.945827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:34.946266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.010764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:35.012526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:35.014717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:35.018517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bbc7dfd3-e12a-41d2-9ef0-3ded509c772d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085522 Aug 02 09:21:35.019093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 995/2011] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:34 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:35.021719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:35.022159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.022926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:35.023354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.055170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6d6a105e-61e7-420b-9ffc-01f45ae4ba3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Aug 02 09:21:35.055736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1017/2012] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:35.346645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:35.347263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:35.351095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:35.353281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:35.353499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:35.353955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.354749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:35.355768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.361134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:35.361325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:35.361570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.361896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:35.362676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:35.403142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56e41c21-513a-43cc-83d4-f7f9846bbbfa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055778 Aug 02 09:21:35.403735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1018/2013] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:35.499229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:35.507315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-50cfab6b-dd78-4863-ac59-305736180be9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164774 Aug 02 09:21:35.507891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 996/2014] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:36.041250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:36.041935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:36.048588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.049039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.049855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.050293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.067850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:36.070236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:36.077615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.078059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.078833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.079265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.112354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4890999a-cc94-4fd5-9dd5-f3c16c608ce6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048635 Aug 02 09:21:36.112944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 997/2015] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:36.119635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:36.127806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-470e035a-5a35-4d5b-91c8-6a14d7e4e319 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090481 Aug 02 09:21:36.128371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1019/2016] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:36.415833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:36.418716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:36.424900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.425376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.426145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.426580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.458843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-486be912-e805-4695-a0d0-557020983ea8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046998 Aug 02 09:21:36.459417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 998/2017] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:36.529532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:36.530148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:36.539142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.539597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.540389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:36.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:36.688082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:36.695849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a1d4908f-ce12-418a-9241-b27269be4790 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.170949 Aug 02 09:21:36.696445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1020/2018] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:37.128704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:37.131083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:37.137894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.138332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.139125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.139557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.148919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:37.149558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:37.156997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.157485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.158262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.158690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.174149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ec6d0bf7-ba0a-4bc2-bc8b-16300c38f994 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049808 Aug 02 09:21:37.174889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 999/2019] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:37.232663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:37.239944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fea41f7f-1dd6-4c6b-a24d-a8802f385c39 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.094940 Aug 02 09:21:37.240529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1021/2020] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:37 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:37.472463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:37.474561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:37.480811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.481303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.482094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.482531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.516284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-05382179-ec60-4c6b-aa4d-6fb94e25857f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048402 Aug 02 09:21:37.516873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1000/2021] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:37.720646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:37.721283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:37.727502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.727889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.728666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:37.729100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:37.748110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:37.865431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:37.874555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aaa948f5-5934-419c-aa5f-4647deb17e44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157758 Aug 02 09:21:37.875148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1022/2022] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:38.187532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:38.189745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:38.196737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.197228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.198078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.199371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.230685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-800f8b19-cd70-4afd-bbcf-c628f910b043 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 Aug 02 09:21:38.231273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1001/2023] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:38.261174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:38.261896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:38.268771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.269277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.270066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.270504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.345344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:38.353297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2757cc6b-fd5b-4da7-a89f-4519ac7aeca5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.095965 Aug 02 09:21:38.353994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1023/2024] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:38 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:38.529278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:38.531439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:38.538107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.538560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.539340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.539777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.571639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-60b7f369-0d96-4fac-9beb-a78da4511385 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 Aug 02 09:21:38.572213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1002/2025] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:38.897363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:38.897996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:38.905341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.905853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:38.906702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:38.907579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.043330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:39.059784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-61e65bba-3f56-4d67-bd20-feabaf53f81f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166255 Aug 02 09:21:39.060378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1024/2026] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:39.243247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:39.245560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:39.252147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:39.252592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.253386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:39.253817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.285397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bbeda8e2-6d63-40a9-903e-598ab01fb2ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 Aug 02 09:21:39.285968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1003/2027] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:39.375852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:39.376711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:39.383293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:39.383737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.384501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:39.384934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.449246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:39.457020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-766d0218-cafc-4078-b8ae-17c79a59467b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084990 Aug 02 09:21:39.457664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1025/2028] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:39.585391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:39.587535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:39.594106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:39.594556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.595336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:39.595771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:39.626821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-155614d7-3a2b-4207-8963-2d1b9d547503 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 02 09:21:39.627400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1004/2029] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:40.082021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:40.082643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:40.089986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.090586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.091253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.091696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.301165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:40.304647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:40.313049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.313537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.314513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.314961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.352704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4748d4d-a8cb-4bcd-a5a1-e95bb944af40 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058651 Aug 02 09:21:40.353333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1005/2030] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:40.466522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:40.474416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b02c4cc-39bf-41cf-8ac7-0858c2d0cdf9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.396282 Aug 02 09:21:40.475013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1026/2031] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:40.478103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:40.478840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:40.486046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.486509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.487294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.487735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.551876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:40.559808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2a5b9a3f-5be8-447f-9b3a-d1072e01baeb tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085821 Aug 02 09:21:40.560395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1006/2032] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:40 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:40.640441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:40.642636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:40.649216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.649676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.650475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:40.650916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:40.683043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5804b10f-7d70-4467-8af0-34eb07c33e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Aug 02 09:21:40.683672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1027/2033] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:41.366508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:41.368659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:41.375415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.375870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.377056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.377522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.409412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e22f1237-a7af-4f20-9b96-6ce57eea15c9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 Aug 02 09:21:41.410025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1007/2034] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:41.496266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:41.497243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:41.504564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.505000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.505809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.506272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.581607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:41.582286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:41.588722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.589612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.590576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.591020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.654760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:41.662944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:41.663489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02dfd4a0-07a4-4489-a7e4-dd52cbcc9c06 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.171349 Aug 02 09:21:41.664144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1028/2035] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:41.671073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-69787cfb-f18f-411b-9ab5-5dbb62b15b26 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093876 Aug 02 09:21:41.671658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1008/2036] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:41 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:41.695768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:41.698052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:41.704959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.705436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.706199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:41.706824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:41.741334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a1e2f466-6eed-4387-81b4-f186316cf5a3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049550 Aug 02 09:21:41.741929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1029/2037] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:42.422340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:42.424523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:42.431254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.431702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.432488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.433096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.463059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e630c313-6ff6-481a-952b-5e38a835d964 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Aug 02 09:21:42.463633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1009/2038] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:42.685546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:42.686111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:42.692839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.693013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:42.693317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.693768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:42.694080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.694544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.700964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.701452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.702239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.702708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.772956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:42.781646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4ab6b410-71d7-4e5d-9299-c565bf32840a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092866 Aug 02 09:21:42.782228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1010/2039] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:42.789714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:42.789714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:42.796459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.796904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.797716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:42.798156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:42.830085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-52b19e5d-4b01-4d9c-98ff-1323da775927 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046745 Aug 02 09:21:42.830984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1011/2040] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:42.846187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:42.853980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ed5c845-cc36-4a41-bd8b-b27eb9133b57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.172649 Aug 02 09:21:42.854561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1030/2041] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:43.477418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:43.479971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:43.487040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.487520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.488308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.488749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.515288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:43.522188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f56347c5-fade-4658-a0d8-a3f2ed444cad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048753 Aug 02 09:21:43.522777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1012/2042] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:43.803311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:43.803932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:43.812297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.812745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.813569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.814009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.844020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:43.846262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:43.852759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.853232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.854013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.854449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.882588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:43.890562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d60a55c3-9b61-4ea7-b1fe-36be95263628 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091138 Aug 02 09:21:43.891165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1031/2043] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:43 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:43.891488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95c7ebd8-2d22-427e-bc3e-bf9dcd332bd9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052577 Aug 02 09:21:43.892242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1013/2044] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:43.896615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:43.897258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:43.904312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.904770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.905587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.906029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.046233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:44.054839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01b7f88a-21ed-46eb-8952-b16da47f24d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161985 Aug 02 09:21:44.055356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1032/2045] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:44.534454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:44.536603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:44.543348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:44.543799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.544579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:44.545022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.577205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d658335e-0746-45db-8e27-187a8c5a4493 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046725 Aug 02 09:21:44.577793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1014/2046] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:44.904869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:44.907249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:44.913460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:44.914063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:44.914422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:44.914876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.920957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:44.920957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.921324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:44.921441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.922437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:44.922877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:44.957351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d278e530-96e1-4bee-9d09-7d075023ac69 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057454 Aug 02 09:21:44.957948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1033/2047] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:45.010348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:45.018552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fd3eb633-3f09-4bfd-91c5-e5578b9605f0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.109196 Aug 02 09:21:45.019136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1015/2048] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:45.075596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:45.076214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:45.078136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:45.083839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:45.084294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:45.085073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:45.085536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:45.223581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:45.231707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7c9b08a6-fa92-4367-81ad-3b71459b7551 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160122 Aug 02 09:21:45.232286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1034/2049] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:45.590131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:45.592352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:45.599028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:45.599478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:45.600240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:45.600671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:45.635156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-afb28d7a-6c7b-4aaa-b508-0cde8468461b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049427 Aug 02 09:21:45.635730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1016/2050] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:45.970977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:45.973225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:45.979970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:45.980667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:45.981497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:45.981937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.012808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41c0b606-ab13-4489-b4f4-7540b4370c68 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045907 Aug 02 09:21:46.013488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1035/2051] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:46.038926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:46.039535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:46.045779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.046223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.046988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.047425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.109698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:46.117456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-137188fb-ccba-46cc-842d-fa3117ff8437 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082342 Aug 02 09:21:46.118034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1017/2052] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:46.254217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:46.254844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:46.261033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.262160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.262943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.263381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.400264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:46.408926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a62daab3-9d76-46a7-a42f-7ab296b23452 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158852 Aug 02 09:21:46.409540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1036/2053] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:46.646879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:46.649055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:46.656573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.657028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.657847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.658303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.688625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e7a3abb-be82-4eb5-9480-26a2fcd8c00f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045767 Aug 02 09:21:46.689222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1018/2054] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:47.025565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:47.027733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:47.034324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.034781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.035553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.035991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.066469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b3c8d9c-1497-4817-8516-f13086a0eab5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 02 09:21:47.067056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1037/2055] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:47.139738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:47.140357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:47.146433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.146888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.147657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.148093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.210494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:47.218441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4bd35ddd-d4a7-431f-b416-f725a9c8a0af tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083384 Aug 02 09:21:47.219030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1019/2056] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:47 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:47.430591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:47.431211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:47.438091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.438543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.439324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.439764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.580217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:47.588060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0cbdfeaf-d157-4fb6-91ad-6f06e44a163d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161516 Aug 02 09:21:47.588642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1038/2057] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:47.701426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:47.703584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:47.710236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.710679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.711441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.711870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.744026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e576c159-c301-4297-9a37-be627b36325e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046757 Aug 02 09:21:47.744616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1020/2058] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:48.079485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:48.081695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:48.088382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.088830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.090199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.090641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.094584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:48.125549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fed1fcfa-8ac3-4d00-9932-cd03e78b518e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050066 Aug 02 09:21:48.126145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1039/2059] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:48.239921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:48.240452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:48.247095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.247544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.248333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.248776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.313480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:48.321073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7293a96c-7343-4fbd-8c14-68956ee15e60 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085371 Aug 02 09:21:48.321676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1021/2060] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:48.610592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:48.611200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:48.617285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.617729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.618488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.618915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.756014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:48.756918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:48.759211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:48.764506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7f2d7ac7-92de-4a77-82eb-b42630bb4594 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157720 Aug 02 09:21:48.765094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1040/2061] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:48.766127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.766583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.767360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.767792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.803882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40290d05-7326-426e-b391-a843f58fefb0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050859 Aug 02 09:21:48.804460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1022/2062] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:49.138561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:49.140931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:49.147781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.148230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.149008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.149546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.181615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b098fb0-3aa4-4d42-bdee-3bc8bed537e0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Aug 02 09:21:49.182097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1041/2063] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:49.342718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:49.343330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:49.349718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.350162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.350957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.351413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.418151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:49.426409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-35f4336c-c1e2-4f23-9e1a-57692f31823d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088163 Aug 02 09:21:49.426989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1023/2064] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:49.786634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:49.787253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:49.794051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.794502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.795310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.795750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.816459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:49.818651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:49.825590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.826046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.826816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.827247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.860343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2f56646b-4727-48c1-97f7-3565a5d17f0f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Aug 02 09:21:49.860916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1024/2065] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:49.943746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:49.952628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6398d86c-d81e-47e4-84d0-e1c12ddf3600 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169900 Aug 02 09:21:49.953416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1042/2066] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:49 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:50.194160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:50.196316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:50.203417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.203865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.204643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.205080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.236263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f8032127-4b29-45c3-8727-3a21451edbf6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Aug 02 09:21:50.236836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1025/2067] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:50.447941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:50.448527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:50.455745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.456198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.456988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.457470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.525165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:50.533161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-466d7abc-67d3-495b-869e-5ef64163d24e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089219 Aug 02 09:21:50.533743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1043/2068] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:50 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:50.881055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:50.883247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:50.885209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:50.892064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.892513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.893312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.893747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.924458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-22baa283-44a5-4ff8-80ed-8b04319b3998 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055006 Aug 02 09:21:50.925047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1026/2069] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:50.975649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:50.976843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:50.986796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.987244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.988026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.988460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.125729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:51.134463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-58e7da14-e981-4112-80c5-d231acdd12d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164806 Aug 02 09:21:51.134963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1044/2070] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:51.249028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:51.251224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:51.257710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:51.258157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.258945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:51.259383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.289269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4b093dbb-4f11-4bf2-ac2b-e2464aaf7173 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Aug 02 09:21:51.289854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1027/2071] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:51.554848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:51.555456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:51.562242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:51.562685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.563441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:51.563880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.629750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:51.637926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e9cf8018-699f-4ec4-bc06-7120a9851491 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087005 Aug 02 09:21:51.638514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1045/2072] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:51.936804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:51.938995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:51.945663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:51.946115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.946887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:51.947327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:51.976726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-049dca71-f1f9-4b29-a2f2-e645e3180155 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Aug 02 09:21:51.977337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1028/2073] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:52.156935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:52.157573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:52.163947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:52.164396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:52.165200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:52.165644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:52.303061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:52.305166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:52.305400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:52.313378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2dd01c66-822f-41a9-a26a-3b75e542b15b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160356 Aug 02 09:21:52.313978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1046/2074] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:52.321777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:52.322671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:52.324461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:52.325457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:52.341360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:52.358254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f4bca329-65ee-44f7-a718-a1ad845fbfa2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059305 Aug 02 09:21:52.358834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1029/2075] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:52.658962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:52.659575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:52.666056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:52.666499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:52.667393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:52.667923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:52.738355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:52.747381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cf2a73b0-a985-4ab1-9e1b-c36504e66f12 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092128 Aug 02 09:21:52.749932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1047/2076] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:52.991904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:52.994345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:53.003596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.004041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.004823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.005299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.044441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b4ae56ba-b1b8-4a3d-b267-88851e505b85 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058377 Aug 02 09:21:53.045491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1030/2077] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:53.335252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:53.335864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:53.342838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.343290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.344077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.344778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.371356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:53.373594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:53.380670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.381141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.381924 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.382450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.418081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-963abed4-ec02-4faa-ab58-3b0a4aa734f2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051159 Aug 02 09:21:53.418665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1031/2078] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:21:53.515588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:53.525448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-be919bdc-d36a-43ef-ac72-c90db0d213b6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.193036 Aug 02 09:21:53.527413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1048/2079] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:53.771466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:53.772089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:53.778421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.778877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.779665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:53.780109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:53.843280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:53.850904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-156998c4-e8dc-4689-b6c8-bee92f7283a3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083352 Aug 02 09:21:53.851477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1032/2080] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:53 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:54.061023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:54.063149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:54.069938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.070388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.071169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.071604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.102176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0edffd07-6377-4e4a-954f-71dbf9e62ef6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Aug 02 09:21:54.102765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1049/2081] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:54.431975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:54.434389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:54.441022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.441499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.442265 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.442694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.473694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1396d988-ff47-48b9-9739-8e1b9730c54e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Aug 02 09:21:54.474264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1033/2082] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:54.549915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:54.550523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:54.556745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.557228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.558076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.558515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.700173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:54.707994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11be937d-1121-46a4-a1a7-5588a4575fcc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161883 Aug 02 09:21:54.708578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1050/2083] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:54.877704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:54.878330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:54.884394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.884848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.885653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:54.886760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:54.957341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:54.966530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98a94c1a-5a22-4178-85f3-eb3256fc4eac tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.093025 Aug 02 09:21:54.967122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1034/2084] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:55.115052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:55.117257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:55.124561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.125014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.125823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.126264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.158913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5c4d86f-2b36-45fd-b66f-d6df7a4cbd9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 Aug 02 09:21:55.159507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1051/2085] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:55.486525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:55.488706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:55.495933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.496387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.497200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.497641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.530362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf914160-ae89-4028-a4ab-2a01bef99516 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047816 Aug 02 09:21:55.530946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1035/2086] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:55.729802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:55.730418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:55.736508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.737020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.737769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.738207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.875416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:55.883523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-484e3c6a-ae11-45ce-88f1-127231b38c2a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.157558 Aug 02 09:21:55.884116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1052/2087] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:55.986851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:55.987514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:55.993873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.994308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:55.995064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:55.996003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:56.059502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:56.067561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef71ad53-012c-4752-bafc-1201f18f08c2 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084562 Aug 02 09:21:56.068148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1036/2088] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:56.171811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:56.174024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:56.180257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:56.180701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:56.181512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:56.181948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:56.213647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5b3ceb6c-ed86-49ac-ae44-6e91d4707f0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046119 Aug 02 09:21:56.214293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1053/2089] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:56.543694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:56.546223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:56.552997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:56.553498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:56.554302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:56.554741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:56.586944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1ef60326-d29d-48c4-8e8f-8df0a85794e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047776 Aug 02 09:21:56.587513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1037/2090] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:56.905966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:56.906896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:56.913017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:56.913494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:56.914257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:56.914688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.086824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:57.087859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:57.088522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:57.094866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:57.095321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.096099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:57.096541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.098037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-905ebabb-5192-4b81-ae95-5ffa01707574 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.196140 Aug 02 09:21:57.098710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1054/2091] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:57.163339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:57.172317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1f2f0c39-5adb-4044-835c-e1f58f475219 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088233 Aug 02 09:21:57.172914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1038/2092] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:57 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:57.226461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:57.228657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:57.236084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:57.236535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.237372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:57.237806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.265397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:57.270776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a2fe3495-2637-4983-8223-e28f22dee66b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048346 Aug 02 09:21:57.271374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1055/2093] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:57.599675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:57.601937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:57.609478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:57.609931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.610714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:57.611153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:57.643076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f757ad43-7018-472e-b8b5-d2d63afd95a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047383 Aug 02 09:21:57.643666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1039/2094] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:58.120831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:58.121448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:58.128447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.128883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.129701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.130141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.193898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:58.194604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:58.201651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.202195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.203038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.203541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.275401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:58.277230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:58.285537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-264386fc-b9dc-4a9c-b3e2-8d7c3127335c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169207 Aug 02 09:21:58.286242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1056/2095] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:58.289359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-167dbb90-133a-4ca6-a9b6-3d4d80a4f8f6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.099264 Aug 02 09:21:58.290198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1040/2096] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:58.291168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:58.293395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:58.300330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.300811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.301615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.302049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.395412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa2b8027-2fd5-43ed-95e7-6eb844a40673 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/action" status: 200 len: 41376 microversion: 2.1 time: 0.107806 Aug 02 09:21:58.395993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1057/2097] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:21:58 2022] POST /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511/action => generated 41376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:21:58.658027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:58.661335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:58.673140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.673588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.674385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:58.674851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:58.707208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6bffbc91-9c2c-4668-a15a-205b1eb5f158 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055538 Aug 02 09:21:58.707781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1041/2098] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:59.308054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:59.308919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:59.315627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:59.316629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:59.316830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:59.317083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:59.317897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:59.318330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:59.323152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:59.324147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:59.324925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:59.325411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:59.389496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:59.397350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-45596755-70cc-4658-8ec2-fd622e1c48df tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086217 Aug 02 09:21:59.397984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1042/2099] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:59.469443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:59.477216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a681f7cd-8ccb-4ee7-9ce0-a4b39bb6c35b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173456 Aug 02 09:21:59.477799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1058/2100] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:21:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:59.720235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:59.722361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:59.729174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:59.729681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:59.730571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:59.731219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:59.762998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ac178ca1-165b-4eca-b41b-2fbaf0f2a8ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Aug 02 09:21:59.763587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1043/2101] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:21:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:00.421342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:00.421985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:00.428823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:00.429373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:00.430089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:00.430533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:00.499039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:00.499222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:00.499822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:00.506247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:00.506729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:00.507505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:00.507887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83c3adce-154c-4317-aa54-513a7cb95b27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091154 Aug 02 09:22:00.508013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:00.508493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1059/2102] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:00 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:00.664403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:00.673397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a0f07104-ce5c-4a1d-9d4b-cf07e6f41038 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.178510 Aug 02 09:22:00.673973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1044/2103] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:00.775603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:00.778509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:00.785197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:00.785651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:00.786449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:00.786866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:00.830338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-081fe866-cff2-470b-8719-598eed496f44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058672 Aug 02 09:22:00.830937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1060/2104] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:01.529692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:01.530331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:01.536980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:01.537474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:01.538257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:01.538717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:01.603845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:01.612336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f65833f7-6d8b-4240-8cbf-53904b4c99d3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086777 Aug 02 09:22:01.612913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1045/2105] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:01 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:01.695414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:01.695971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:01.703141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:01.703579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:01.704345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:01.704775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:01.847941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:01.852353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:01.854426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:01.863482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81ab2264-fbb1-4b0c-8d37-154947fa1869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.171998 Aug 02 09:22:01.864085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1061/2106] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:01.865260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:01.865717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:01.866503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:01.866940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:01.869641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:01.899130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-16256799-21d5-4d15-89ef-bb4a46c8149f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059840 Aug 02 09:22:01.899701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1046/2107] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:02.635015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:02.635636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:02.642693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:02.643142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:02.643923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:02.644361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:02.709066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:02.717047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-06ada931-652d-489f-b95a-f76bc050433c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086119 Aug 02 09:22:02.717684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1062/2108] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:02.887223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:02.887759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:02.894727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:02.895171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:02.895944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:02.896375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:02.912617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:02.915051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:02.921642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:02.921988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:02.922797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:02.923235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:02.961579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1cbed85b-c893-4884-9d7d-4aa58d60799d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052944 Aug 02 09:22:02.962169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1063/2109] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:03.045456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:03.053068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3922acc7-89e3-4004-8dc5-aa3bba8e7139 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.170471 Aug 02 09:22:03.053684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1047/2110] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:03.738580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:03.739173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:03.746125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:03.746514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:03.747206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:03.747650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:03.813361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:03.821011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8d7c1592-9a3e-433e-bc36-1ab50cbdd8b5 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086524 Aug 02 09:22:03.821629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1064/2111] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:03 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:03.974485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:03.976711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:03.983931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:03.984525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:03.985411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:03.985913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.076728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:04.077408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:04.084028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:04.084480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.085785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:04.085785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.173543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-551f4cd0-54d4-4638-90d3-d3b9f7c8a6cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202771 Aug 02 09:22:04.176690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1048/2112] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:04.240741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:04.249961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6322f692-a283-4c08-9dee-303322e564e6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.177846 Aug 02 09:22:04.250564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1065/2113] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:04.756826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:04.757348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:04.767964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:04.768433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.769260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:04.769691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.842159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:04.842764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:04.849730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:04.850171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.851206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:04.851647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:04.918359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:04.926184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd234d39-c1ea-4eeb-b441-b78a9b54761a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088135 Aug 02 09:22:04.926760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1066/2114] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:05.186228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:05.188359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:05.194562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:05.195028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:05.195781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:05.196254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:05.227978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ac8cf7c-f219-4ee4-846d-1928e1c54b34 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Aug 02 09:22:05.228559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1067/2115] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:05.272715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:05.273358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:05.279814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:05.280259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:05.281038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:05.281492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:05.434398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:05.442459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e54cfb94-d623-4074-9aca-e4da1345a5cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173434 Aug 02 09:22:05.442948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1068/2116] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:05.947451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:05.948126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:05.955562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:05.956033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:05.956798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:05.957256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:06.022491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:06.030173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9bf7a201-cafc-47a8-9227-23ed356444f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086557 Aug 02 09:22:06.030756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1069/2117] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:05 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:06.241328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:06.243374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:06.249648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:06.250094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:06.250885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:06.251321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:06.284205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3feea5ee-6ba4-499a-9c8c-fb89de5de0fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Aug 02 09:22:06.284784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1070/2118] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:06.463991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:06.464632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:06.470786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:06.471228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:06.472072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:06.472426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:06.615474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:06.624119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c5743d04-ac74-4fe9-872c-df93c8737978 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164088 Aug 02 09:22:06.624702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1071/2119] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:07.051617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:07.052311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:07.060071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:07.060511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:07.061328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:07.061764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:07.125562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:07.129409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:07.134688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85d6d0bc-714d-4178-a584-15e326ac7229 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086882 Aug 02 09:22:07.135274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1072/2120] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:07.296979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:07.299164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:07.305326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:07.305766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:07.306530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:07.306959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:07.341217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-65b31532-fa1e-4c9b-a992-14fddf9b0d93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048998 Aug 02 09:22:07.341795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1073/2121] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:07.646035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:07.646564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:07.654094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:07.654540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:07.655320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:07.655752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:07.806456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:07.815617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cabc9721-de45-448c-a1bf-5dad1385db6f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173537 Aug 02 09:22:07.816215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1074/2122] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:08.155473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:08.156154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:08.163024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:08.163451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:08.164217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:08.164647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:08.241530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:08.250717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c35915bf-f96d-4a20-a1b2-e59f4ec215ae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.099292 Aug 02 09:22:08.251310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1075/2123] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:08 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:08.353723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:08.356578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:08.362896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:08.363351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:08.364137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:08.364578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:08.395581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-22b8e8af-68f9-4b44-b143-675976d63918 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045827 Aug 02 09:22:08.396154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1076/2124] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:08.837444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:08.838152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:08.844537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:08.844979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:08.845784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:08.846219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:09.007906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:09.016261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-36d4e5af-7418-4d4b-a32e-33822fd1fd15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.182661 Aug 02 09:22:09.016861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1077/2125] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:09.272610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:09.273326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:09.281058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:09.281542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:09.282326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:09.282775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:09.348215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:09.356828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e89cc53b-44dd-4de3-8974-9e059032a42a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088077 Aug 02 09:22:09.357450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1078/2126] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:09 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:09.408357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:09.410541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:09.416657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:09.417695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:09.419103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:09.419538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:09.452219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d10c494f-22f6-487d-8f8a-05db3184b672 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Aug 02 09:22:09.452802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1079/2127] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:22:10.038624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:10.039249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:10.045772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:10.046207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:10.046992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:10.047432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:10.186080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:10.193860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-076e7358-0900-401e-8f9e-6972180b983c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159116 Aug 02 09:22:10.194453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1080/2128] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:10.378175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:10.378884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:10.388692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:10.389157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:10.389930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:10.390367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:10.460896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:10.470668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-be451404-8da9-454f-af95-6f858c3c7737 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.096586 Aug 02 09:22:10.471261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1081/2129] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:10 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:10.475983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:10.478170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:10.486176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:10.486649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:10.487428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:10.487860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:10.521997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95035e15-951a-4f2a-911f-99d916fbaef7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049640 Aug 02 09:22:10.522595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1082/2130] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:11.216756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:11.217378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:11.223516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:11.223962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:11.224732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:11.225256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:11.374975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:11.383894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5784abd3-a4db-4264-a061-ed68cc350c7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.171800 Aug 02 09:22:11.384518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1083/2131] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:11.493140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:11.493705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:11.496238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:11.502911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:11.503363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:11.504150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:11.504596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:11.576919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:11.584627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52bb3d21-2596-4292-9bd0-1ca836361de1 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.096365 Aug 02 09:22:11.585225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1084/2132] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:11 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:11.590046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:11.592202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:11.598289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:11.598733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:11.599491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:11.599921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:11.631873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a99e482-066b-4dc0-a716-fc89547fe8ea tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 02 09:22:11.632455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1085/2133] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:12.406468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:12.407159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:12.414062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.414514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.415295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.415737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.556402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:12.564210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ddb3ece0-c00a-4a78-9073-9042b67d0bb8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162369 Aug 02 09:22:12.564812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1086/2134] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:12.607457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:12.608079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:12.614410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.614858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.615630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.616065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.681228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:12.689122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-49bf1b4f-79be-46c3-926b-aca0dff937be tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086697 Aug 02 09:22:12.689724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1087/2135] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:12 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:12.694453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:12.696593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:12.710291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.710741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.711524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.711963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.742788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c73e5b2f-418c-4f43-9c4f-7e960f0edb40 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051989 Aug 02 09:22:12.743371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1088/2136] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:13.585937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:13.586645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:13.593283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.593734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.594510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.594951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.615398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:13.735474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:13.743480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a1ea4c67-3c04-46e5-91de-5409a242e385 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161437 Aug 02 09:22:13.744079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1089/2137] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:13.749869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:13.750504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:13.756991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.757548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.758456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.759888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.822271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:13.830683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-20ab5a98-88c2-446e-9e3e-cf6595f216cc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085599 Aug 02 09:22:13.831279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1090/2138] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:13 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:13.836038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:13.838122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:13.845238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.845676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.846460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.846898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.879497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0ab8ff0-dd6e-4a26-b43b-c59e8d3d92c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Aug 02 09:22:13.880085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1091/2139] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:14.765090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=47 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:14.766528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:14.767563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:14.774205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:14.774657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:14.775438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:14.775871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:14.793034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=21 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:14.921284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:14.929782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b2329528-0d5b-4c41-a05b-10df1b126bf6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.167124 Aug 02 09:22:14.930370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1092/2140] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:14.935011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:14.935608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:14.941593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:14.942041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:14.942815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:14.943241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.005865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:15.014150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1a50af4e-433d-4c69-9311-faafb5121998 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082766 Aug 02 09:22:15.014734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1093/2141] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:14 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:15.019430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:15.021603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:15.028864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.029366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.030153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.030609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.061338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-189d4692-4eda-4b59-82f1-66d7e2d38ede tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 02 09:22:15.061928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1094/2142] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:15.951359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:15.952037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:15.958634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.959076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.959840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.960272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.099318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:16.108560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-241f935a-e241-4e49-bc1e-c5e1ad2a5bfb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160800 Aug 02 09:22:16.108687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1095/2143] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:16.113688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:16.114314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:16.120744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.121239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.122035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.122479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.186791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:16.194596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2f7cd07c-491a-4a80-9efa-fff4d305c976 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084886 Aug 02 09:22:16.195185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1096/2144] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:16 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:16.200078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:16.202264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:16.208516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.208965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.209775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.210213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.241837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4952f1a-1e4f-475d-95ae-41e69de2aec9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Aug 02 09:22:16.242577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1097/2145] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:17.133088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:17.133753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:17.141062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.141534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.142308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.142745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.279629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:17.287607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb9c14d1-2b3c-4350-b500-ebef6425b627 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158333 Aug 02 09:22:17.288198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1098/2146] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:17.292828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:17.294050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:17.300969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.301465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.302249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.302692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.366972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:17.376308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7d89bc5-188c-4cbe-99b4-ec8f3fd0d83e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086870 Aug 02 09:22:17.376905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1099/2147] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:17 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:17.381870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:17.383984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:17.390309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.390759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.391538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.391977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.422974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd0e38e8-a20c-4858-a77c-d240ed19cba1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Aug 02 09:22:17.423554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1100/2148] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:18.310738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:18.311637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:18.318339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:18.318795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:18.319568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:18.320009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:18.465935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:18.473684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-36829cb2-b0ff-49e5-9f10-6036053f08cf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.167398 Aug 02 09:22:18.474287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1101/2149] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:18.483823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:18.483823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:18.486280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:18.486737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:18.487520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:18.487970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:18.552704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:18.561088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f2642a51-7cfa-4888-9462-dd4596adb14a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085716 Aug 02 09:22:18.561634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1102/2150] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:18 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:18.566341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:18.568516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:18.575102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:18.575566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:18.576341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:18.576806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:18.607652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-846c11d0-0951-471f-bab5-ca5029123178 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 02 09:22:18.608223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1103/2151] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:19.496166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:19.496944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:19.503779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:19.504227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:19.504991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:19.505464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:19.648223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:19.655812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0e7c0dbe-fba6-4d9d-9c01-dfe49e668e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163507 Aug 02 09:22:19.656386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1104/2152] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:19.661070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:19.661704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:19.667566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:19.668005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:19.669465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:19.669986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:19.731750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:19.739252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bd1cfd58-ac70-4fd3-8d1e-cf99fa70a48b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081908 Aug 02 09:22:19.740026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1105/2153] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:19 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:19.744335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:19.746512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:19.753443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:19.753898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:19.754667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:19.755108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:19.758826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:19.787020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5f87a3b-11da-4738-8385-b52df73066bf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Aug 02 09:22:19.787587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1106/2154] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:20.677884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:20.678559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:20.685775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.686215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.686965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.687392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.817630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:20.825843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85a68406-4662-4209-8827-1d93e38f364e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.151785 Aug 02 09:22:20.826412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1107/2155] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:20.830733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:20.831333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:20.836885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.837372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.838228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.838640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.902018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:20.909899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ebb0a123-3a5e-4166-9fa5-721963b72318 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.082527 Aug 02 09:22:20.910484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1108/2156] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:20 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:20.915043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:20.917330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:20.924339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.924790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.925599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.926032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.956519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c7497263-a8f6-40b0-9afe-78632ab5ee1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Aug 02 09:22:20.957007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1109/2157] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:21.847910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:21.848593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:21.855221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:21.855667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:21.856575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:21.857001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.003774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:22.011581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d7e85286-0b64-449f-8c8c-85468aadd50c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.167591 Aug 02 09:22:22.012706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1110/2158] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:22.017364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:22.017971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:22.023954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:22.024399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.025193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:22.025625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.090209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:22.099305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ca11a1da-1cab-4511-908b-72216f8d799b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085369 Aug 02 09:22:22.099811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1111/2159] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:22 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:22.104467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:22.107357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:22.113849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:22.114298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.115081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:22.115635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.147800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa8f8f27-5fdc-4680-a188-823dd813a89d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046928 Aug 02 09:22:22.148375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1112/2160] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:23.034525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:23.035182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:23.042806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.043252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.045380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.045827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.194433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:23.202920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-064d6cb3-b5c9-475d-8118-5a3758f97a33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.172320 Aug 02 09:22:23.203511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1113/2161] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:23.208055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:23.208680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:23.214692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.215142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.216540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.216980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.281344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:23.289176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd77895d-3e2e-4c37-8771-97e4202a9550 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084584 Aug 02 09:22:23.289707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1114/2162] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:23 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:23.294659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:23.296806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:23.302943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.303395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.304170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.304606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.335253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f1b3c494-20f2-4cb7-a8a7-52c4227b6e7b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Aug 02 09:22:23.335831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1115/2163] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:24.225674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:24.226346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:24.233103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.233581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.234363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.234813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.376065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:24.384024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5f9f50b-3bfc-433b-bb4f-0839d6a7cd27 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162351 Aug 02 09:22:24.384684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1116/2164] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:24.389817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:24.390488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:24.397917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.398374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.399166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.399602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.463043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:24.471627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc442e85-e430-4c8d-b6ac-2a83deea6f5c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085876 Aug 02 09:22:24.472213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1117/2165] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:24 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:24.476920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:24.479051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:24.487059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.487518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.488335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.488789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.528806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21fec041-eda6-4c41-931e-7676837ce29f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054926 Aug 02 09:22:24.529436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1118/2166] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:25.407314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:25.408018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:25.414635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:25.415079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:25.415844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:25.416273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:25.557592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:25.566094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e37eeea-42ef-4cf0-9217-cd38489ba289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162822 Aug 02 09:22:25.566697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1119/2167] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:25.571273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:25.571887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:25.578291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:25.578741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:25.579601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:25.580051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:25.643651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:25.651660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95a4ae72-fb3a-4736-bf07-a2b320eb6edd tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083895 Aug 02 09:22:25.652252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1120/2168] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:25 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:25.657134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:25.659357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:25.665525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:25.665975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:25.666751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:25.667189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:25.699234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b03d0a6d-59e7-48b5-adf3-8c485dfd34f8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Aug 02 09:22:25.699856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1121/2169] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:26.588089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:26.588777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:26.596343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.596790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.597592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.598025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.736827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:26.740419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:26.745628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ef74581-9680-4b55-9e6b-cb761ecd63ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161566 Aug 02 09:22:26.746222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1122/2170] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:26.751804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:26.752418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:26.759024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.759479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.760277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.760730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.826911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:26.834617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b71480a5-74f8-407b-8759-d33f8ec3d53d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086691 Aug 02 09:22:26.835195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1123/2171] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:26 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:26.839856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:26.843552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:26.849725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.850164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.850938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.851393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.892669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-922ac89b-b36d-4a7b-8102-a09d767bb454 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056377 Aug 02 09:22:26.893289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1124/2172] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:27.769025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:27.769753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:27.776450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.776904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:27.777811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.778764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:27.929477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:27.938626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d87fcfbf-0e48-4428-bdfd-f2e0560d0b12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.173485 Aug 02 09:22:27.939217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1125/2173] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:27.943710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:27.944312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:27.950762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.951208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:27.951992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.952417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.021976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:28.030325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33423ec4-4787-42a3-8a43-2470e80bbad4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090079 Aug 02 09:22:28.030917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1126/2174] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:27 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:28.035747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:28.037952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:28.050245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.050700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.051495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.051937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.083824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0eb77b9f-e124-4501-ae15-a66bb071c8bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051831 Aug 02 09:22:28.084405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1127/2175] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:28.963990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:28.964713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:28.972084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.972526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.973325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.973761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.120885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:29.133183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-84679a96-1f6e-4e36-a593-6a420fba339b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.169894 Aug 02 09:22:29.133183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1128/2176] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:29.135269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:29.135893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:29.144936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.145850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.146895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.147511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.212682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:29.223282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52cad291-ec16-4355-bd80-4f162c9411d4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091443 Aug 02 09:22:29.224184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1129/2177] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:29 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:29.231402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:29.235420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:29.247518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.247970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.248940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.249513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.281542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4a2c685-48b1-4637-9b7a-2bdabf8b28ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056083 Aug 02 09:22:29.282125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1130/2178] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:30.156787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:30.157502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:30.164165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.164622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.165434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.165879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.313395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:30.321069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-adb07d85-cbdf-454a-b39d-285a00fcf533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.168195 Aug 02 09:22:30.321673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1131/2179] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:30.327427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:30.328036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:30.334581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.335005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.335777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.336208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.552739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:30.561787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c19683fa-a295-4b22-9f93-913323719fba tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.239096 Aug 02 09:22:30.562381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1132/2180] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:30 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:30.567190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:30.569353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:30.575736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.576229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.577007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:30.577473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:30.609818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c37e0e8-5f77-4542-a5f9-f13fd8f4fe7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Aug 02 09:22:30.610393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1133/2181] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:31.344480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:31.345245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:31.347561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:31.352921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.353426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.354205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.354638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.499261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:31.503126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-397d9a57-d313-44bd-8d97-45b41874c996 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162459 Aug 02 09:22:31.503715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1134/2182] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:31.583364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:31.584140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:31.590578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.590927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.591779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.592154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.655161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:31.662853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5970fb69-74c0-4b5a-884a-9cadfb4b26ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083470 Aug 02 09:22:31.663746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1135/2183] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:31 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:31.669637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:31.671567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:31.677725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.678167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.678924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:31.679356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:31.710006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa39814d-ab23-4499-b697-e1598cc41a29 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Aug 02 09:22:31.710578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1136/2184] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:32.525350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:32.526043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:32.533948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:32.534400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.535181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:32.535611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.675713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:32.683320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-15e0b2d3-c0a5-46a0-8061-3ebb9a9fc7e9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.162002 Aug 02 09:22:32.683905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1137/2185] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:32.691795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:32.692422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:32.698707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:32.699196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.701211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:32.701684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.772172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:32.780820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-976b925e-58e0-44f2-9def-f99cd876311f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092683 Aug 02 09:22:32.781355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1138/2186] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:32 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:32.786133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:32.788272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:32.795352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:32.795803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.796581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:32.797010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:32.815214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:32.830059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-16aa618d-4016-411d-b4b8-28ce4a3c71f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Aug 02 09:22:32.830641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1139/2187] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:33.706423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:33.707142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:33.719210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.719210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.719583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.719822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.858527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:33.866262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bdee9e96-4712-4858-8f38-47a5f67ef8b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163748 Aug 02 09:22:33.866828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1140/2188] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:33.871293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:33.872092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:33.878362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.878807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.879570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.879994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.944555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:33.954717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b447842d-53f5-4492-afc5-47180237d313 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086738 Aug 02 09:22:33.955354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1141/2189] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:33 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:33.961003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:33.964411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:33.971935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.972386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:33.973178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:33.973615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:34.004660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6945d382-b5ee-400f-a954-c9b6c0891156 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 Aug 02 09:22:34.005261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1142/2190] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:34.887987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:34.888705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:34.896241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:34.896692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:34.897509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:34.897948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.054087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:35.062270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd488880-8600-47bb-9a37-d8f7c0a7e2a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.178188 Aug 02 09:22:35.062879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1143/2191] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:35.067343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:35.067948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:35.074275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:35.075082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.075790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:35.076225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.156780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:35.170058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a3f17744-6fbf-4fc4-bc6b-d00dd16a6e9b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.105800 Aug 02 09:22:35.171017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1144/2192] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:35 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:35.178582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:35.181313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:35.190395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:35.190910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.191715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:35.192156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:35.223983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0a0763c7-9016-492c-8ece-1d22f23ff107 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051543 Aug 02 09:22:35.224553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1145/2193] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:36.083277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:36.083960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:36.091487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:36.091936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:36.092737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:36.093189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:36.240189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:36.248226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b9d4bb4b-414b-41ae-8bde-c8fe3f89c437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.168823 Aug 02 09:22:36.248808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1146/2194] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:36.253955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:36.254560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:36.260590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:36.261033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:36.261827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:36.262965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:36.326668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:36.334389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-839c41bd-57b0-4839-bacd-f57f559c77ef tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084558 Aug 02 09:22:36.334965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1147/2195] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:36 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:36.339680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:36.342586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:36.356575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:36.357099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:36.357915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:36.358359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:36.390319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c6397465-5b0b-433a-a3c0-31b7ca9707ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054261 Aug 02 09:22:36.390898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1148/2196] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:37.270960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:37.271674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:37.279514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:37.279967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:37.280757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:37.281219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:37.424309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:37.432229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39b7d78c-8cc4-4d42-8cc1-72868c92e526 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.165163 Aug 02 09:22:37.432816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1149/2197] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:37.437506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:37.438123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:37.444148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:37.444598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:37.445401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:37.445840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:37.511346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:37.519719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c811646f-6ac9-469c-a615-57bd3ef29549 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085832 Aug 02 09:22:37.520313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1150/2198] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:37 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:37.525267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:37.527389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:37.534724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:37.535171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:37.535950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:37.536390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:37.567511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b27d3b4e-3389-4214-9aa6-2bb0788b3688 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046109 Aug 02 09:22:37.568105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1151/2199] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:38.456901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:38.457954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:38.468479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.468928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.469739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.470181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.608416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:38.620331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95d20e80-dc03-466a-a475-6fcb0b5b9e2f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.170898 Aug 02 09:22:38.620935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1152/2200] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:38.626097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:38.626708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:38.633143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.633590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.634369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.634810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.702950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:38.713004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-972a72ca-9dca-42bd-ae1c-bd8462c4f04d tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090392 Aug 02 09:22:38.713560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1153/2201] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:38 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:38.720611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:38.721259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:38.727995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.728451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.729275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:38.729720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:38.760796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-04f81081-02b9-48ca-9731-40228d423321 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Aug 02 09:22:38.761414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1154/2202] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:39.642813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:39.643572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:39.650363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.650806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.651586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.652023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.796932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:39.805550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ff3af8c-9d30-40e9-bb95-929047379840 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166547 Aug 02 09:22:39.806147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1155/2203] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:39.810862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:39.811566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:39.822497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.822947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.823721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.824154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.829263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:39.888417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:39.896384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4719c57f-a333-4f31-b3cd-d6a5afae5157 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.089039 Aug 02 09:22:39.896900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1156/2204] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:39 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:39.905164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:39.905164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:39.911126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.911577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.912362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:39.912802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:39.945712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4bd1248f-6c7c-402b-aaea-d572846078c3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047657 Aug 02 09:22:39.946292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1157/2205] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:40.832695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:40.833841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:40.843001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:40.843447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:40.844223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:40.844660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:40.984575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:40.992676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-600883be-60a8-4243-a072-68b0a2895a12 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.168016 Aug 02 09:22:40.993481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1158/2206] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:40.998871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:40.999493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:41.006229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.007591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.008549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.009029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.073216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:41.081958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f364127-8477-474b-8be9-c83189a82d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087422 Aug 02 09:22:41.082544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1159/2207] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:40 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:41.087384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:41.090190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:41.095896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.096345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.097141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:41.097580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:41.130154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3c70f506-4ce1-4584-a902-c09cac6ae216 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046534 Aug 02 09:22:41.130748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1160/2208] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:42.015582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:42.016271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:42.022975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.023430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.024209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.024652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.166173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:42.183259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3db72a6-e6ee-4f33-9f56-70cb4ec2d86a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.171499 Aug 02 09:22:42.183768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1161/2209] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:42.193210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:42.193210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:42.196586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.197066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.197837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.198273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.264684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:42.272367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d1cbb4aa-8d15-433b-a660-4076b2bd0618 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086248 Aug 02 09:22:42.272947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1162/2210] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:42 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:42.278242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:42.280399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:42.286856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.287312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.288098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:42.288538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:42.320099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-167bec74-b4d8-4400-a2c2-2964885a3b1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Aug 02 09:22:42.320673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1163/2211] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:43.204582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:43.205257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:43.211951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.212404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.213202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.213644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.355166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:43.364052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-705dd563-8e71-423a-a569-a8561147e88d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163361 Aug 02 09:22:43.364676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1164/2212] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:43.369422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:43.370048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:43.377141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.377599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.378639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.379084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.443784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:43.452033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6ceb738-eea1-4834-8940-116a4b8ca3e6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086294 Aug 02 09:22:43.452610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1165/2213] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:43 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:43.457489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:43.459568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:43.466312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.466763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.467532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:43.467970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:43.499208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-547b1695-b0eb-45f1-bcd0-485f1b9dc80c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Aug 02 09:22:43.499791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1166/2214] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:44.387156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:44.387874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:44.394912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.395365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.396142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.396577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.542264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:44.551027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3721d05d-6324-4698-b3d7-60852d1bc533 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.167945 Aug 02 09:22:44.551604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1167/2215] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:44.556096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:44.556701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:44.562724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.563168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.563924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.564352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.627486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:44.635810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52fdb964-db67-4f23-b790-f4b8165c7e23 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083223 Aug 02 09:22:44.636393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1168/2216] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:44 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:44.641890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:44.643936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:44.652684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.653998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.654912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:44.655350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:44.685655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa6fe7e8-3026-426e-99de-93bff81dd948 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Aug 02 09:22:44.686235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1169/2217] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:45.572222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:45.572835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:45.580353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:45.580798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:45.581763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:45.582507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:45.722164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:45.729795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-888a97a1-329b-4e6c-9fac-4d1602272d4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.161480 Aug 02 09:22:45.730377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1170/2218] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:45.735829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:45.736431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:45.742570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:45.743014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:45.743784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:45.744209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:45.808180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:45.816570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5e9cc7de-3013-45e2-9b9c-885e956b51a6 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.085025 Aug 02 09:22:45.817072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1171/2219] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:45 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:45.821711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:45.823838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:45.831107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:45.831568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:45.832358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:45.832789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:45.859076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:45.864333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-505e4fa8-2d43-4225-b5d9-338275d1031d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046224 Aug 02 09:22:45.864917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1172/2220] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:46.751884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:46.752615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:46.759473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:46.759921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:46.760694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:46.761165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:46.907807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:46.915504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ddcb8a12-899d-41f9-bfe2-9d3c2ff0801e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.167610 Aug 02 09:22:46.916127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1173/2221] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:46.921685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:46.921685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:46.927917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:46.928359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:46.929152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:46.929581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:46.993039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:47.001074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a656efb3-cb8e-4cd3-8c42-cfb1ce8a9d67 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083867 Aug 02 09:22:47.001684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1174/2222] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:46 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:47.006641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:47.008763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:47.016168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:47.016607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:47.017416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:47.017854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:47.049421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-be045534-4c14-4a17-a3fe-fbb32623ceec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046628 Aug 02 09:22:47.050010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1175/2223] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:47.937314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:47.937997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:47.944544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:47.944998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:47.945802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:47.946248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:48.087401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:48.096081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1f64a35b-e139-4daa-9c53-bd141bbd8f4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.163064 Aug 02 09:22:48.096669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1176/2224] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:48.101146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:48.101803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:48.108003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:48.108445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:48.109245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:48.109674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:48.180007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:48.188541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-70a2b53b-f23a-43fa-9afc-7b4128d86d2a tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.090776 Aug 02 09:22:48.189131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1177/2225] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:48 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:48.193901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:48.196060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:48.203076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:48.203564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:48.204323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:48.204762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:48.235025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2d6805e4-b5f5-48f7-a6d4-6a42f263c2f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 02 09:22:48.235617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1178/2226] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:49.117682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:49.118439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:49.125311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:49.125760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:49.126539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:49.126971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:49.271998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:49.280413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-22449b37-9c07-4e36-8b1d-73549e4550d8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166671 Aug 02 09:22:49.281006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1179/2227] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:49 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:49.285648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:49.286262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:49.298662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:49.298662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:49.298662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:49.298662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:49.358235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:49.366402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dbcbe4e9-22cc-4c2b-97fc-fbbc32ec0a84 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084300 Aug 02 09:22:49.366985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1180/2228] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:49 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:49.371838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:49.374043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:49.382875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:49.383315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:49.384109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:49.384571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:49.416872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e6bcbed0-78ba-45ef-8d90-721db7498ece tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048746 Aug 02 09:22:49.417534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1181/2229] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:49.753982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:22:49.754252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:22:50.302503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:50.303187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:50.310272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:50.310763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:50.311536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:50.311962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:50.471741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:50.479424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d16cb46c-8613-4277-a890-07191137ce90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.180826 Aug 02 09:22:50.480001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1182/2230] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:50.485255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:50.485926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:50.491910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:50.492339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:50.493104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:50.493627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:50.558388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:50.568208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0456ceae-be40-41be-a444-33a708ee1f6c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087171 Aug 02 09:22:50.568797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1183/2231] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:50 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:50.573545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:50.575818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:50.577836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:50.583339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:50.583791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:50.584573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:50.585010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:50.616598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18301336-41dc-4d5f-a1c2-4fe20b7dbf25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046681 Aug 02 09:22:50.617211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1184/2232] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:51.501917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:51.502913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:51.509483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:51.509938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:51.510725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:51.511162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:51.650332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:51.659217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b63030c-582b-42ae-80ac-43828bf3ecdb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.160909 Aug 02 09:22:51.659823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1185/2233] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:51.664468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:51.665090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:51.674480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:51.675230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:51.676509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:51.677265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:51.747035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:51.755499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19c4bc46-9e5a-4354-a134-bb6998d52684 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.094636 Aug 02 09:22:51.756087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1186/2234] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:51 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:51.760753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:51.763736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:51.770726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:51.771178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:51.771961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:51.772400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:51.802750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f7160a42-e708-46e7-9f93-54ac1e425478 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Aug 02 09:22:51.803326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1187/2235] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:51.810981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:22:51.811155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:22:52.681451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:52.682232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:52.689684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:52.690141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:52.690933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:52.691365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:52.828863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:52.836544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e6d4d0bd-cacd-45e9-841f-1747658fef15 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159082 Aug 02 09:22:52.837258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1188/2236] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:52.842328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:52.842953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:52.849251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:52.849713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:52.850499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:52.850943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:52.884397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:52.930331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:52.939001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-854d8634-7119-4113-a497-b28577320c27 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.100314 Aug 02 09:22:52.939527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1189/2237] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:52 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:52.944269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:52.946446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:52.953205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:52.953667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:52.954453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:52.954891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:52.987810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2f28fd36-c8fd-44f1-bf2f-d6884324b9ae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047170 Aug 02 09:22:52.988392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1190/2238] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:53.860403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:53.861216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:53.868861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.869343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:53.870125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:53.870686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:54.027048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:54.037757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc911ef2-0782-4af7-a21f-57bfa0581ff5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.181742 Aug 02 09:22:54.038460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1191/2239] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:54.044809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:54.045526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:54.052407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:54.053033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:54.053973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:54.055436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:54.132323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:54.140492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1a049f32-ea9e-4af3-9a70-1907e34b5266 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.100905 Aug 02 09:22:54.142285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1192/2240] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:54.147437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:54.150887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:54.159325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:54.159771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:54.160544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:54.160971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:54.194719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8c897a6-bc02-4fe2-bc4e-e24816471b9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052161 Aug 02 09:22:54.195757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1193/2241] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:55.062033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:55.062740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:55.069690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.070138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.070915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.071352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.213416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:55.221662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0f80a15-5d23-4898-9df8-7de8bcd1ab14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164320 Aug 02 09:22:55.222245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1194/2242] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:55.229474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:55.229474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:55.234039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.234487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.235255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.235683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.298910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:55.306669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ebc0fd97-75ea-4ab4-b00d-c3791d9bed8f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.083407 Aug 02 09:22:55.307256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1195/2243] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:55.312769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:55.314947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:55.321514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.321978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.322782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:55.323224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:55.353912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d98d249b-632c-4315-a2eb-7f1438d2e573 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Aug 02 09:22:55.354489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1196/2244] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:56.244188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:56.244881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:56.251518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:56.251964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.252733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:56.253200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.390776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:56.398901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0c5fd3f2-aa91-48cb-a5e4-84bfa696c23f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158841 Aug 02 09:22:56.399483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1197/2245] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:56.405056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:56.405697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:56.412464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:56.412900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.413768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:56.414226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.478274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:56.486730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c874b1d8-e436-4341-a053-020439f2578e tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086230 Aug 02 09:22:56.487355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1198/2246] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:56.491990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:56.494529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:56.501080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:56.501566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.502354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:56.502791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:56.533721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab960c65-80f0-473d-94f8-5f59d746d6f5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Aug 02 09:22:56.534304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1199/2247] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:57.421428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.422126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.428789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.429274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.430053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.430488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.573500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:57.581860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4a262510-2421-4ee2-84f5-3b8b760ebd0d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164412 Aug 02 09:22:57.582454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1200/2248] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:57.587331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.587956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.594756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.595208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.595985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.596428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.660601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:57.668843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b048c5a-0ce7-4c58-b245-c18721ca43de tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.084790 Aug 02 09:22:57.669445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1201/2249] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:57 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:57.674632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.676746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.683063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.683510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.684932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.685404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.724602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d4c142e0-30f8-4d3a-929f-d6864721bcd3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053994 Aug 02 09:22:57.725334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1202/2250] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:22:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:58.603987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:58.604670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:58.612036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.612486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.613290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.613726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.751146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:58.759172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-00b699e4-15f7-4687-b56c-f262c8414031 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.159005 Aug 02 09:22:58.759758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1203/2251] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:58.765222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:58.765840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:58.771964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.772414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.773224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.773663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.840809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:58.848830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0345ee0d-da26-4c24-912b-2f1a99c1adae tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088037 Aug 02 09:22:58.849452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1204/2252] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:58 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:58.854124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:58.856874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:58.870222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.872265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:58.872702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:58.971771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdcf9ad7-ddf2-4bb3-bf1f-60949feb196d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/action" status: 200 len: 76687 microversion: 2.1 time: 0.120956 Aug 02 09:22:58.972365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1205/2253] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:22:58 2022] POST /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f/action => generated 76687 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:22:59.604209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:22:59.604915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:22:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:22:59.783207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:59.783903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:59.791196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.791638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:59.792403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.792833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:59.812966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:59.935509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:59.943567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a023d08-29ee-4a9f-a424-f9df3b50a250 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.164563 Aug 02 09:22:59.944146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1206/2254] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:59.948707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:59.950117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:59.956358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.956879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:59.957624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.958060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:00.023176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:00.031204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f91bde4-0956-4830-8e75-a931cdf71884 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.086000 Aug 02 09:23:00.031789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1207/2255] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:22:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:00.965991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:00.966681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:00.973387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:00.973841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:00.974625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:00.975069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.133668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:01.142270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fad182de-efbf-4eaa-a165-b059cb210f08 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.180240 Aug 02 09:23:01.142856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1208/2256] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:23:01.147533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:01.148158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:01.156397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.156856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.157663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.158106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.225721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:01.235072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60d10cd8-74a1-4042-8721-0dfd9955cb42 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091166 Aug 02 09:23:01.235709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1209/2257] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:01 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:02.163950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:02.164635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:02.172192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.172564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.173453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.173896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.318373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:02.326328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-65f38138-306a-4ffc-85e2-5d073950f352 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.166229 Aug 02 09:23:02.326922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1210/2258] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:23:02.331464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:02.332077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:02.338286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.338737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.339509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.340558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.410110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:02.419074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a10194dd-d334-44b0-886e-c0c2054793b4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.091108 Aug 02 09:23:02.419670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1211/2259] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:02 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:03.348076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:03.348761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:03.358157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:03.358618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:03.359408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:03.359849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:03.517344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:03.525285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8dafb3d5-33a7-44e3-939f-5c7057addbab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.181067 Aug 02 09:23:03.525869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1212/2260] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:23:03.531617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:03.532241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:03.538473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:03.538926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:03.539708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:03.540148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:03.608110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:03.615872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5fd22d42-d30f-4734-88e2-07ecf88314f4 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.088966 Aug 02 09:23:03.616454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1213/2261] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:03 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:04.547735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:04.548427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:04.558542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.559519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.560315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.560757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.711135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:04.719264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-112047bb-39b2-4a6c-a39c-f3ec04361dfe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.175697 Aug 02 09:23:04.719846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1214/2262] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:23:04.724453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:04.725064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:04.731862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.732292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.733079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.733550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.800211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:04.807870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c50496b6-bda2-4f61-ba60-a4b0720b384f tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.087008 Aug 02 09:23:04.808454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1215/2263] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:23:04 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:04.816156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:04.816660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:04.823110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.823559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.824463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.824907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:14.821028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=65 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:14.847617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=60 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:05.034800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:24:05.255850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:24:15.039796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:15.260202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:30.376927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:24:30.377649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:24:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:26:05.846979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR oslo.messaging._drivers.impl_rabbit [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [eb32e779-4d19-4fa2-93e6-c986e4d0c648] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 09:26:05.926765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:26:05.929093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:26:05.930591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:26:05.931554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:26:05.932789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:26:05.934578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:26:05.938185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) Aug 02 09:26:05.940306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:26:05.942114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ed2d5e9-d926-4018-a4c3-cf5bbd22c9d3) {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:26:05.942114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69591757-fbaf-4798-b091-f73d213274ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 181.118558 Aug 02 09:26:05.942114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1216/2264] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:23:04 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 269 bytes in 181120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:26:05.942114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:26:05.942542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:26:05.946628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:05.947173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:05.948009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:05.948539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:06.100129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:26:06.109435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-869a8747-41e3-477e-b079-96226d07d09b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.176949 Aug 02 09:26:06.109710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1217/2265] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:26:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:26:06.114696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:26:06.115313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:26:06.121532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:06.121978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:06.122744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:06.123265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:06.214937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:26:06.223633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-49c2538c-35b4-422b-8626-e0a38eff0ff3 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.112508 Aug 02 09:26:06.224239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1218/2266] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:26:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:26:06.229081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:26:06.229560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:26:06.236376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:06.236986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:06.237798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:06.238242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:06.854450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [eb32e779-4d19-4fa2-93e6-c986e4d0c648] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 48872. Aug 02 09:26:06.859468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-899098a8-eabb-4e58-ab55-0e96a57e8a3b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 202 len: 0 microversion: 2.1 time: 242.106580 Aug 02 09:26:06.860063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1049/2267] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:22:04 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 242108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:26:06.865743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:26:06.866451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:26:06.874540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:06.874993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:06.875762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:06.876200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:07.055267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:26:07.067374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17c1a98c-92f3-4539-83ab-150290383e99 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.206077 Aug 02 09:26:07.068142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1050/2268] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:26:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:26:07.072804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:26:07.073441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:26:07.079772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:07.080230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:07.081008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:07.081477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:07.152338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:26:07.161337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed510930-f77c-46f1-8004-504237e26efc tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.092032 Aug 02 09:26:07.161910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1051/2269] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:26:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:26:07.166504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:26:07.167002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:26:07.174692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:07.175146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:07.175918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:26:07.176374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:26:09.762633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:26:09.763258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:26:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:26:11.830259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:26:11.830950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:26:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:26:16.233896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:16.256394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=16 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:17.170719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:17.195517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:26:19.612948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:26:19.613646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:27:50.386003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:27:50.386609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:27:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:28:06.248369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:28:06.437489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:28:09.636492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:28:09.637076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:28:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:28:16.252187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:28:16.442291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:29:29.771148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:29:29.771741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:29:31.839006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:29:31.839672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:29:39.620956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:29:39.621612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:29:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:30:06.693361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:30:06.695623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:30:06.697581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:30:06.698642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:30:06.700393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.702204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:30:06.703500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) Aug 02 09:30:06.704920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3ed3462-b277-4ece-8348-261cc404b9e8) {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 240.471922 Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:30:06 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-b3cc5750-af0c-4d08-b10b-61f6c30c2292 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:30:06.706560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:30:06.707675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1219/2270] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:26:06 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 240474 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:30:06.732651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:30:06.736061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:30:06.737698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:30:06.738461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:30:06.739737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.741090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:30:06.742371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) Aug 02 09:30:06.743961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d33eefc-952a-4fdc-a0d9-9ff38c37efc9) {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 239.577699 Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:30:06 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-67331667-2adb-4b09-9f84-b798ef056896 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:30:06.745979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:30:06.746552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1052/2271] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:26:07 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 239580 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:30:06.748844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:30:06.749668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:30:06.758113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.758699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.759515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.760272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.768807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:30:06.771149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:30:06.778760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.779142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.780168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.780607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.829885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:30:06.838145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.094435 Aug 02 09:30:06.838666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:30:06.838666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:30:06 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:30:06.839246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-aa818664-4f44-449a-b246-4de84e0e7d3b tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:30:06.839246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:30:06.839246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:30:06.839561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1053/2272] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:30:06 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:30:06.843946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:30:06.844441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:30:06.850204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.850649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.851407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.851841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.924701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:30:06.932871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.233347 Aug 02 09:30:06.933448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:30:06.933448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:30:06 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:30:06.934033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-f3b4531b-a271-4c46-8fa4-580cc7254825 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:30:06.934033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:30:06.934033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:30:06.934304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1220/2273] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:30:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:30:06.938527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:30:06.939134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:30:06.944719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.945205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:06.945976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:06.946984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:07.079688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:30:07.087296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c784b2e-519d-4ba2-b24b-bc0eee1b1dbc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.152193 Aug 02 09:30:07.087850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1221/2274] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:30:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:30:07.092333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:30:07.092954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:30:07.098461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:07.098915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:07.099678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:07.100123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:07.161760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22a27db106e45e68444fa022d254c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4b022cdf9c448dbb51c5ffd9212181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:30:07.170060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7700ed1c-c07f-40f6-a2cb-6527e3d5c504 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 200 len: 1228 microversion: 2.1 time: 0.081255 Aug 02 09:30:07.170630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1222/2275] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:30:07 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 1228 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:30:07.175123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:30:07.175615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:30:07.181362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:07.181820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:07.182588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:30:07.183033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:30:16.847600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:30:16.871837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=10 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:30:17.178588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=8 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:30:17.200761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=22 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:31:10.394390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:31:10.394887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:31:29.644807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:31:29.645467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:31:40.281961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:31:40.282541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:32:07.060236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:32:07.149489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:32:17.064667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:32:17.155445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:32:49.780145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:32:49.780863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:32:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:32:51.847445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:32:51.848086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:32:59.629533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:32:59.630128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:33:54.832571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:33:54.834825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:33:54.836754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:33:54.837984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:33:54.840740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.843738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:54.846267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) Aug 02 09:33:54.848879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-70d3f753-b8c3-474e-8c32-aede5284e391) {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 227.995986 Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:54 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-5acd1040-4877-45fd-8c7f-de423ba523ac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:33:54.851088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:33:54.852738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1054/2276] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:30:06 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 227998 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:54.852738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:54.852738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:54.852738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:54.853567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:54.853567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:54.853567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:54.869923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:33:54.872376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:33:54.874851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:33:54.876119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:33:54.877567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.879091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:54.880509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) Aug 02 09:33:54.882057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.883459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-72be3d78-a17a-4de0-9465-c697a9aa32d1) {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:33:54.885711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 227.713746 Aug 02 09:33:54.886272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:33:54.886272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:33:54 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:33:54.886979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-659f8250-29f1-45e0-9a64-de28b8c40a69 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:33:54.886979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:33:54.886979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:33:54.887239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1223/2277] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:30:07 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 227716 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:54.894600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:54.895221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:54.901637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:54.902214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:54.903092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:54.903685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:54.919645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:33:54.923849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:54.925401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:33:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:54.927490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.036837 Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:33:54 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-1b6515e3-9b7f-4727-87a1-9d5dbfd9e3b0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:33:54.928681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1224/2278] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:33:54 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:54.932478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:54.933103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:54.939423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:54.939758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:54.940591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:54.940988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.014643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:33:55.022348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.183953 Aug 02 09:33:55.023273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:33:55.023273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:33:55.023945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-9258b9fe-f130-46c5-b052-48aaf5e8d987 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:33:55.023945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:33:55.023945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:33:55.025080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1055/2279] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:33:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:55.029230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:55.030004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:55.036022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.036467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.037256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.037692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.176309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:33:55.184588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1571 microversion: 2.1 time: 0.158893 Aug 02 09:33:55.185204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:33:55.185204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:33:55.185896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-b2f4d2e4-62be-47d7-b01b-f551a34339ad tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:33:55.185896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:33:55.185896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:33:55.186176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1056/2280] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:33:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:55.190577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:55.191249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:55.197647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.198161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.198926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.199359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.212675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:33:55.214278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:55.215589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:33:55.216429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:33:55.217731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.028560 Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-f43df5ef-e9e3-486c-b81f-3cafd2dce4c0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:33:55.218998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1057/2281] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:33:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:55.304112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:55.304607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:55.311727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.312172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.312947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.313387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.339957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:33:55.422642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.204462 Aug 02 09:33:55.423198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (ip 10.222.0.100) !!! Aug 02 09:33:55.423198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:33:55 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (10.222.0.100) Aug 02 09:33:55.423865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-ef3e48d8-9a82-458e-ae4f-19df69cc46bf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Unhandled error: OSError: write error Aug 02 09:33:55.423865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:33:55.423865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:33:55.424199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1058/2282] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:33:55 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:33:55.429185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:33:55.429797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:33:55.435818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.436277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:33:55.437041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:33:55.437504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:34:04.936405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:34:04.960020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:34:05.433947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:34:05.459729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:34:07.471080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:34:07.524834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:34:17.487402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:34:17.537301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:34:30.402828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:34:30.403480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:34:49.653912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:34:49.654545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:35:55.365521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:35:55.368354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:35:55.370096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:35:55.371046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:35:55.372217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.373482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.374550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) Aug 02 09:35:55.375845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c89d50e2-3f6f-4801-a19c-1d3bba01a6e0) {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 120.442847 Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-3a1cac73-a65a-4f8b-b953-ef124af708a8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:35:55.376974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:35:55.378899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1225/2283] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:33:54 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 120444 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.402176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:35:55.405588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:35:55.407354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:35:55.408112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:35:55.410772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.412146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.418241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) Aug 02 09:35:55.420228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f440852f-c8a8-4b7e-b48c-b8b92a26608e) {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 119.990728 Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:35:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-4c3e2a9c-49c7-4c2d-8f7a-26a794bbc2f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:35:55.421798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:35:55.422419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1059/2284] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:33:55 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 119992 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.538961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.540051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.548624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.549483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.550967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.551478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.571951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.572724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.579730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.580118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.580887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.581358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.596884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:35:55.598476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.600083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:35:55.601132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.602780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.182008 Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:35:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-97c5deb2-facb-4158-9fec-3bf6a9760e7c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:35:55.604211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1060/2285] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:35:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.606121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.606616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.613044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.613574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.614344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.614786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.643087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:35:55.700012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.compute.api [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:35:55.700580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:35:55.700979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.098628 Aug 02 09:35:55.701574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (ip 10.222.0.100) !!! Aug 02 09:35:55.701574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:35:55 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (10.222.0.100) Aug 02 09:35:55.702155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-c2937aa9-6e91-4fda-ae3f-e93a15fce864 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Unhandled error: OSError: write error Aug 02 09:35:55.702155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:35:55.702155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:35:55.702398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1061/2286] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:35:55 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.710048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1565 microversion: 2.1 time: 0.338134 Aug 02 09:35:55.711020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:35:55.711201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:35:55.712034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-57f44400-0fb6-454e-9ad0-3af3d0d160a4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:35:55.712034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:35:55.712034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:35:55.712461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1226/2287] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:35:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.712869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.713385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.717155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.717771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.720611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.720978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.721770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.722200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.723920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.724370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.725370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.725815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.861881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:35:55.874381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1565 microversion: 2.1 time: 0.160783 Aug 02 09:35:55.874903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:35:55.874903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:35:55.875487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-8e8e1d20-ff25-4e93-bb09-45b7c77e396b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:35:55.875487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:35:55.875487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:35:55.875744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1227/2288] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:35:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.879997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.880611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.887083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.887537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.888302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.888748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.902462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:35:55.903996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.905625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:35:55.906524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:35:55.907976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.028876 Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-6a2f612c-ea68-41d0-9f5b-871efc3312ad tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:35:55.909375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1228/2289] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:35:55 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:55.910944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:55.911434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:55.917928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.918381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.919166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:55.919623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:55.951381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:35:55.994771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:35:55.995594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.088178 Aug 02 09:35:55.996104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (ip 10.222.0.100) !!! Aug 02 09:35:55.996104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:35:55 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (10.222.0.100) Aug 02 09:35:55.996680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-f3920c30-e6c9-4126-86a4-bb44aad72476 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Unhandled error: OSError: write error Aug 02 09:35:55.996680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:35:55.996680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:35:55.996971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1229/2290] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:35:55 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:35:56.001419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:35:56.001911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:35:56.007943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:56.008389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:35:56.009183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:35:56.009622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:36:05.716715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:36:05.740121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:36:06.005409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=10 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:36:06.028147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:36:07.744049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:36:07.788911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:36:09.788363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:36:09.789060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:36:11.855702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:36:11.856445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:36:17.747952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:36:17.793171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:36:19.637999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:36:19.638645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:36:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:36:40.292934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:36:40.293608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:37:50.410935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:37:50.411694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:37:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:37:56.083243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:37:56.085495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:37:56.087052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:37:56.087760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:37:56.089080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.090330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.091478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) Aug 02 09:37:56.092675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e972ae0-1158-4924-b7a2-905522ff5f80) {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 120.383870 Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-b02c49f4-a508-44ef-a399-45c03cc0f47d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:37:56.094066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:37:56.094746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1062/2291] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:35:55 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 120385 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.094746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.094939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.101692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.102148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.102919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.103361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.171619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:56.174184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:37:56.176139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:37:56.176964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:37:56.178301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.179496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.180751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) Aug 02 09:37:56.183700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cdcd13d0-eade-492d-a689-8be4af6120c6) {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 120.178948 Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-33203251-6622-4a8d-8208-8423600a1e7f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.185836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.187438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1230/2292] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:35:55 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 120184 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.189429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.190419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.198763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.199293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.200534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.201054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.215819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:56.219406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.221588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:56.222765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.224069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.038586 Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-d76068de-0899-4404-89d9-910d81fe40ca tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.226940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1231/2293] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.229778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.230275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.236620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.237281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.238214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.238862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.247911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1565 microversion: 2.1 time: 0.167600 Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-9759f944-19fb-48dd-81ba-606f3b2c41f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:37:56.258231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1063/2294] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.263337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.264152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.270714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.271176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.271976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.272511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.276567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:56.328390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:56.329204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.104553 Aug 02 09:37:56.329735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (ip 10.222.0.100) !!! Aug 02 09:37:56.329735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (10.222.0.100) Aug 02 09:37:56.331046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-6cf0bd38-20e7-48e1-b849-68456cec9f71 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Unhandled error: OSError: write error Aug 02 09:37:56.331046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.331046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.331357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1232/2295] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:56 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.335620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.336232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.341904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.342424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.343279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.343722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.480157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:56.488018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1565 microversion: 2.1 time: 0.155932 Aug 02 09:37:56.488538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (ip 10.222.0.100) !!! Aug 02 09:37:56.488538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 (10.222.0.100) Aug 02 09:37:56.489142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-36e836e0-466b-45b8-a37e-529f734c5c65 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Unhandled error: OSError: write error Aug 02 09:37:56.489142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.489142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.489415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1233/2296] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.493628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.494225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.499818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.500259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.501038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.501494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.515400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:56.516910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.519130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:56.520071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.521673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.028799 Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (ip 10.222.0.100) !!! Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd (10.222.0.100) Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-87b2d38a-72e7-4b01-af3e-078ee86e30d0 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Unhandled error: OSError: write error Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.522950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1234/2297] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.524450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.524965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.530593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.531032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.531776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.532204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.556089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:56.602045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:56.602864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.081895 Aug 02 09:37:56.603364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (ip 10.222.0.100) !!! Aug 02 09:37:56.603364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d (10.222.0.100) Aug 02 09:37:56.603930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-611f837c-c901-4a51-b0a3-c9ae0b0f6118 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Unhandled error: OSError: write error Aug 02 09:37:56.603930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.603930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.604233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1235/2298] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:56 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.608536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.610726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.616897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.617372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.618123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.618547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.647242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042251 Aug 02 09:37:56.647731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments (ip 10.222.0.100) !!! Aug 02 09:37:56.647731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:37:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments (10.222.0.100) Aug 02 09:37:56.648300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: CRITICAL nova [None req-c55397fe-022e-49a5-a1b9-61793aa08002 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Unhandled error: OSError: write error Aug 02 09:37:56.648300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova OSError: write error Aug 02 09:37:56.648300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova Aug 02 09:37:56.648572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1236/2299] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:37:56.652575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.653194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.658579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.659119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.659862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.660293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.793237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:56.801480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eb99f7f7-2fcd-4568-8d25-e57d02b70af2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1565 microversion: 2.1 time: 0.152092 Aug 02 09:37:56.802050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1237/2300] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:37:56.806467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.807076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.812623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.813072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.813863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.814303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.828164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:56.829773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.831346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:56.832376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:56.833914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:56.835263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:56.835263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a231636b-4668-40c3-a930-25458e35d716 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.028360 Aug 02 09:37:56.835263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1238/2301] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:37:56.836128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.836617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.842136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.842587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.843369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.843813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.870336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:56.914060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:56.914888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3dc7db3c-7816-4992-a8b8-e354dbb32fc0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.082148 Aug 02 09:37:56.915487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1239/2302] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:56 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:37:56.920136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:56.922307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:56.928573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.929040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.929830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:56.930268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:56.960070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-68a4c6d0-d9b5-4918-9499-82ab6d2d480c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Aug 02 09:37:56.960633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1240/2303] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:37:56 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:37:57.020530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c376609c-79b9-4ca5-91a3-febc97aecc9d", "name": "network-vif-deleted", "tag": "8f88553d-e356-4f8a-a98b-0792286f3a79"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:37:57.029970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:57.030419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:57.041720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] Creating event network-vif-deleted:8f88553d-e356-4f8a-a98b-0792286f3a79 for instance c376609c-79b9-4ca5-91a3-febc97aecc9d on hv-cinder-80382 Aug 02 09:37:57.044965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR oslo.messaging._drivers.impl_rabbit [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] [9e5f4e17-e485-4507-9238-c99c1d98c47c] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 09:37:58.052310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] [9e5f4e17-e485-4507-9238-c99c1d98c47c] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 49336. Aug 02 09:37:58.055629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-b171364d-8252-454b-a84c-2a559d242044 req-6073aac5-5231-4a94-84d8-0316babc77e4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.093952 Aug 02 09:37:58.056296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1241/2304] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:37:58.061398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.061980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.068883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.069375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.070140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.070579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.095066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.144922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:58.145780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-836d2223-2f71-4bda-8e52-aabb479a32e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.088398 Aug 02 09:37:58.146347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1242/2305] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:37:58.150756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.151253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.156910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.157395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.158157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.158884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.171693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:58.173423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.175619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:58.176665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.178182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.179676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:58.179676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5c3772a-0cb5-4acb-9b21-dcbf1473615c tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.028200 Aug 02 09:37:58.179676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1243/2306] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:37:58.180359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.182486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.187967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.188417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.189200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.190287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.218476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-619c4e11-5b61-453e-a9b3-3ae6c3f1f707 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Aug 02 09:37:58.219034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1244/2307] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:37:58 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:37:58.223421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.223918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.229437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.229884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.230641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.231079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.249976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:37:58.258400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.331499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cac2b1af-ae4b-44e6-b3e6-9987a7310ade tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 204 len: 0 microversion: 2.1 time: 0.111134 Aug 02 09:37:58.332324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1245/2308] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:37:58.337207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.337788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.343627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.344081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.344847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.345321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.372319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.415504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:58.416325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4014c4b8-dbb2-444e-8266-718382386290 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.083114 Aug 02 09:37:58.416882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1246/2309] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:37:58.421299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.421789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.427778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.428170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.428922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.429394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.442734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:58.444362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.446011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:58.446929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.448394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.449938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:58.449938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e636f986-ab90-40e3-aede-19ee4c193100 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.027933 Aug 02 09:37:58.449938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1247/2310] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:37:58.450651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.452740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.458511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.458965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.459725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.460165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.489234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8393521e-5db4-44a4-96e0-be5c00a69c9b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Aug 02 09:37:58.489779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1248/2311] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:37:58 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:37:58.494069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.494556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.499940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.500380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.501150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.501589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.525854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.571733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Instance is already in deleting state, ignoring this request Aug 02 09:37:58.572540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-23ba722c-4ab6-49a1-a8ff-f7ad039cb863 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 204 len: 0 microversion: 2.1 time: 0.081865 Aug 02 09:37:58.573094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1249/2312] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:37:58.577496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.577983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.583485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.583875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.584644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.585078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.609195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.654571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:58.655388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b96b8dc-a78b-405b-98ca-9f04834dc403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.081364 Aug 02 09:37:58.655944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1250/2313] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:37:58.660853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.661372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.666741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.667185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.667970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.668402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.682003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:58.683487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.685136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:58.686140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.687652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.689226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:58.689226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c42fc48f-2916-4de4-ac61-21a4f38da428 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.028011 Aug 02 09:37:58.689226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1251/2314] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:37:58.690099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.692205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.697994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.698433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.699191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.699624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.729385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b5959ee-f345-4eb5-bc05-cc3d6f22ee10 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Aug 02 09:37:58.729956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1252/2315] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:37:58 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:37:58.734308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.734793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.741144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.741616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.742376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.742811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.770499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.816677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Instance is already in deleting state, ignoring this request Aug 02 09:37:58.817526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5358a019-65a1-4124-9ad4-dc049360d027 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 204 len: 0 microversion: 2.1 time: 0.086630 Aug 02 09:37:58.818119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1253/2316] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:37:58.822523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.823010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.828525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.828963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.829736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.830223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.854754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:58.898633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Instance is already in deleting state, ignoring this request Aug 02 09:37:58.899453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-292ae40b-af59-4169-8281-4e7b517d7557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 204 len: 0 microversion: 2.20 time: 0.080439 Aug 02 09:37:58.900024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1254/2317] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:37:58.904522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.905011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.911814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.912264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.913025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.913494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.927379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=6,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:37:58.928562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:58.930149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.931904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:58.933071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:58.934669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:58.936715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:58.936715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-29b5fb33-b420-45a2-bc4a-43c922d2b7db tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.030602 Aug 02 09:37:58.936715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1255/2318] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:37:58.940787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:58.942940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:58.959130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.959575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.960354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:58.960782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:58.992181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-15ecd715-e9d8-47da-b5fb-cd68280a813c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056107 Aug 02 09:37:58.992748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1256/2319] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:37:58 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:37:59.003660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:59.004156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:59.010745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.011199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.011980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.012413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.037579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:37:59.081626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.compute.api [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Instance is already in deleting state, ignoring this request Aug 02 09:37:59.082448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b7da85f-5358-476e-aa32-4b6bc9027661 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 204 len: 0 microversion: 2.1 time: 0.088760 Aug 02 09:37:59.083214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1257/2320] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:37:58 2022] DELETE /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:37:59.089747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:59.090386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:59.096799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.097271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.098033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.098469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.169627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:59.179602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:59.181749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:59.182904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-23d17eb4-92ca-4c7f-8f86-2ee15c2acb45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.098973 Aug 02 09:37:59.197486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1258/2321] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:37:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:37:59.197486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:59.197486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] [instance: 740332a9-5b49-41cf-9db1-ec96264ed7fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:59.197486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.198309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.198309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.198309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.211995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] HTTP exception thrown: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Request method failure captured: Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd HTTP/1.1 Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oq4RtpCBQWj4FwYbDsi_T-HOF17VD4BizzwkM95ju6Hr_Z-kFvFs7Ct4cm2ur-W6GddagBeE2XhogmL6p4Kbe35hgJHPEHqLkHl5Z9JNeV1lvVkJ8ZpwhLaWeqawP5Yy-8fxNIUtsztzypYv0F1JTDJhAK-HjvgBDOYLc2N_OeVrzA Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:37:59.213678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/9a4b022cdf9c448dbb51c5ffd9212181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 9a4b022cdf9c448dbb51c5ffd9212181 Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-TestVolumeBootPattern-1478851430 Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: d22a27db106e45e68444fa022d254c83 Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-TestVolumeBootPattern-1478851430-project Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:59.215314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '740332a9-5b49-41cf-9db1-ec96264ed7fd'} Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:37:59.216265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. Aug 02 09:37:59.218438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:37:59.220499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Returning 404 to user: Instance 740332a9-5b49-41cf-9db1-ec96264ed7fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:37:59.220499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-73e70b78-ea90-4dd9-bc3f-90b3197e9949 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd" status: 404 len: 111 microversion: 2.1 time: 0.030698 Aug 02 09:37:59.220499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1259/2322] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:59 2022] GET /compute/v2.1/servers/740332a9-5b49-41cf-9db1-ec96264ed7fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:37:59.220499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:37:59.221383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:37:59.227639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.228087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.228859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:37:59.229338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:37:59.296629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:37:59.305080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d1d723e6-8984-46cf-8848-42192c829811 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088309 Aug 02 09:37:59.305674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1260/2323] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:37:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:00.007974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:00.010420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:00.016461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.016919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.018468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.018919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.047423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0ccb0c9-7432-4488-96f1-d8f7313da955 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Aug 02 09:38:00.047980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1261/2324] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:00 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:00.070027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-94dea993-acbd-4239-97af-6e53f0572326 req-b76bb2b1-e7eb-452f-ab69-6cae8a39df79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64272d61-0647-41fa-960d-d71df9c72c70", "tag": "86db858b-f033-44df-ba65-35bb43a0e045"}, {"server_uuid": "64272d61-0647-41fa-960d-d71df9c72c70", "name": "network-vif-deleted", "tag": "86db858b-f033-44df-ba65-35bb43a0e045"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:38:00.079322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-94dea993-acbd-4239-97af-6e53f0572326 req-b76bb2b1-e7eb-452f-ab69-6cae8a39df79 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.079763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-94dea993-acbd-4239-97af-6e53f0572326 req-b76bb2b1-e7eb-452f-ab69-6cae8a39df79 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.090874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-94dea993-acbd-4239-97af-6e53f0572326 req-b76bb2b1-e7eb-452f-ab69-6cae8a39df79 service nova] Creating event network-changed:86db858b-f033-44df-ba65-35bb43a0e045 for instance 64272d61-0647-41fa-960d-d71df9c72c70 on hv-cinder-80382 Aug 02 09:38:00.091421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-94dea993-acbd-4239-97af-6e53f0572326 req-b76bb2b1-e7eb-452f-ab69-6cae8a39df79 service nova] Creating event network-vif-deleted:86db858b-f033-44df-ba65-35bb43a0e045 for instance 64272d61-0647-41fa-960d-d71df9c72c70 on hv-cinder-80382 Aug 02 09:38:00.096365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-94dea993-acbd-4239-97af-6e53f0572326 req-b76bb2b1-e7eb-452f-ab69-6cae8a39df79 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.029837 Aug 02 09:38:00.096933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1262/2325] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:00.213562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:00.214252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:00.220465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.221128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.221920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.222350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.287839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:00.296280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:00.297817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:00.298985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dbbbf160-f32d-41d2-9f14-2a62df1267a3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090223 Aug 02 09:38:00.299677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1263/2326] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:00.326008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:00.326629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:00.333429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.333929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.334706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:00.335152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:00.400220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:00.408595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b92f0ee5-76e2-47fb-aab6-979f2963e2bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086283 Aug 02 09:38:00.409199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1264/2327] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:01.060353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:01.062524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:01.068684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:01.069162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:01.069931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:01.070368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:01.099440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dfa31089-c892-4863-80ca-f756f122a9d7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Aug 02 09:38:01.100066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1265/2328] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:01 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:01.322009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:01.322616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:01.329201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:01.329670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:01.330965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:01.331580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:01.395079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:01.404595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:01.406137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:01.407283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-13ee26b3-c7e3-4a83-98f9-c55de971059f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089270 Aug 02 09:38:01.407843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1266/2329] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:01.429002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:01.429639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:01.436367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:01.436847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:01.437644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:01.438075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:01.498376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:01.506406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-335f3e86-abca-481c-a4d5-c5c39d70892d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081199 Aug 02 09:38:01.507185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1267/2330] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:02.113078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:02.115290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:02.121400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:02.121855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:02.122618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:02.123061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:02.154711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-38344b6b-2cf2-469a-8f4f-40ce999f1771 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Aug 02 09:38:02.155272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1268/2331] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:02 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:02.432376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:02.432990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:02.440007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:02.440784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:02.441783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:02.442228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:02.504563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:02.514579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:02.516181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:02.517392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aec6c718-c88a-440e-9864-d148297d7dd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089082 Aug 02 09:38:02.517950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1269/2332] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:02.527421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:02.528112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:02.534735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:02.535192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:02.535926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:02.536378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:02.599216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:02.606680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40353969-0299-4401-aab3-cb9b69579867 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082836 Aug 02 09:38:02.607241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1270/2333] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:03.166234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:03.168393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:03.174834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:03.175244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:03.175995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:03.176443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:03.205920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-062bbd20-b1ff-43f5-a96c-b05d67a5dbe1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042866 Aug 02 09:38:03.206474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1271/2334] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:03 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:03.540330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:03.540948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:03.547421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:03.547867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:03.548623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:03.549052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:03.566646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:03.611707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:03.620085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:03.621628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:03.622775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-63f831dc-6948-4a5b-83c2-5ebf0cf4dae2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086370 Aug 02 09:38:03.623333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1272/2335] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:03.627880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:03.628491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:03.634460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:03.635185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:03.635984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:03.636420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:03.696928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:03.704409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4de0aaeb-361e-47e7-8284-5ce2fbf51947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080140 Aug 02 09:38:03.705705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1273/2336] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:04.218242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:04.220277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:04.226345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:04.226791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:04.227540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:04.227973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:04.257422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-44b3c4ab-8225-42af-ad62-ee6c36111b4b tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 Aug 02 09:38:04.257974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1274/2337] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:04 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:04.646112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:04.646719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:04.653154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:04.653605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:04.654353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:04.654781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:04.715532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:04.724506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:04.726046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:04.727223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ad2cc84-09b3-436e-8a56-3f678cc9b243 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085079 Aug 02 09:38:04.727785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1275/2338] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:04.732110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:04.732718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:04.739301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:04.739749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:04.740511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:04.740948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:04.804763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:04.812330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56357686-6b57-4be6-93e7-e4fae7acc258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083606 Aug 02 09:38:04.812906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1276/2339] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:05.270578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:05.272785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:05.275824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:05.280287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:05.281255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:05.282250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:05.282479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:05.311412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33f3d3a2-b2b9-4d3d-ab29-9d2c99386990 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Aug 02 09:38:05.311967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1277/2340] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:05 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:05.750717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:05.751258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:05.758582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:05.759034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:05.760063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:05.760498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:05.822688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:05.831511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:05.833055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:05.834233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-74398a4b-e8b0-4f80-8a90-eb401a68df6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087549 Aug 02 09:38:05.834799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1278/2341] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:05.839213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:05.839823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:05.845654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:05.846292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:05.847037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:05.847473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:05.910367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:05.918126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ad79e177-9bfa-4c94-8242-d8d36b04d679 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082286 Aug 02 09:38:05.918696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1279/2342] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:06.268422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:06.295803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=10 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:06.323945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:06.326156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:06.333121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:06.333576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:06.334331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:06.334763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:06.363806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-de2210b6-c2d8-4463-a674-80736597295d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Aug 02 09:38:06.364350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1280/2343] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:38:06 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:38:06.856939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:06.857582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:06.864829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:06.865313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:06.866088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:06.866524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:06.928143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:06.937372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:06.938873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:06.940086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ceb5f0d0-8409-4cf1-8605-a0fa94b600fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087115 Aug 02 09:38:06.940634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1281/2344] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:06.944970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:06.945602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:06.951399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:06.951844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:06.952597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:06.953031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:07.017253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:07.024986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ef7eed6-7eaf-407f-8a2c-02c59903084a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083376 Aug 02 09:38:07.025586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1282/2345] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:07.376164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:38:07.378516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:07.384482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:07.385210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:07.385973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:07.386403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:07.484019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b79b0526-8a32-4350-85b2-c4a4420fb996 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/action" status: 200 len: 76566 microversion: 2.1 time: 0.111563 Aug 02 09:38:07.484697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1283/2346] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:38:07 2022] POST /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0/action => generated 76566 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:38:07.963475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:07.964189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:07.972166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:07.972623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:07.973648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:07.974083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.002232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:38:08.055496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:08.075093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:08.076696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:08.079223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-273d32a6-622e-42aa-8aeb-9a20208185af tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.119652 Aug 02 09:38:08.079804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1284/2347] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:08.088834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:08.089485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:08.096840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.097329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.098106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.098545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.182444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:08.191395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-08550946-2803-401c-b0bb-4be35d7171bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.109340 Aug 02 09:38:08.192167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1285/2348] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:08.196548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:08.197049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:08.213684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.214394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.215183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.215619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.248935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:38:08.342552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5d8760d-bba2-46cb-b787-9be423d63fe3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 204 len: 0 microversion: 2.1 time: 0.149289 Aug 02 09:38:08.343315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1286/2349] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:38:08 2022] DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:38:08.351645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:08.352233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:08.360907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.362273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.363583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.364353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.391964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:38:08.395157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:08.468428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ec4d7322-8a9b-40ba-b1bc-de15691b72a4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 204 len: 0 microversion: 2.1 time: 0.123388 Aug 02 09:38:08.468930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1287/2350] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:38:08 2022] DELETE /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:38:08.474569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:08.475278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:08.481322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.481776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.482548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.482988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.622128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:08.631122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-91f75ac1-ee9e-4424-8913-846de34ca660 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.161037 Aug 02 09:38:08.631695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1288/2351] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:08.636381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:08.636990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:08.642830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.643284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.644049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:08.644484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:08.774927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:08.783136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-31373d75-dce0-4897-a9eb-a72d129167f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150480 Aug 02 09:38:08.783707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1289/2352] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:09.101875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:09.102489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:09.108940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.109408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.110159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.110591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.177084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:09.185812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:09.187337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:09.188480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d388515d-d36f-46c9-a72e-15da5e18c01f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090530 Aug 02 09:38:09.189578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1290/2353] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:09.214851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:09.215515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:09.221360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.221810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.222566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.223032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.285937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:09.293592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-508967df-23c6-4602-9c2a-f6b7e90e4d94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082367 Aug 02 09:38:09.294328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1291/2354] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:09.653047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:09.653745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:09.659884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.660330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.661090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.661548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.792343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:09.801304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6d5fec1a-6555-4797-abcc-71ac2210cd70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152042 Aug 02 09:38:09.801878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1292/2355] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:09.806305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:09.806908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:09.812594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.813035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.813825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:09.814494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:09.942988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:09.950948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4637d676-5dd7-4432-95ec-6fe6fea7c9e3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148096 Aug 02 09:38:09.951511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1293/2356] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:10.211992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:10.212526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:10.219048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.219494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.220963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.221557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.285746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:10.294028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:10.295518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:10.296648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b71febd7-56b7-4ce9-9ee8-22ef080d0775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088803 Aug 02 09:38:10.297220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1294/2357] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:10.313360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:10.314580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:10.320590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.321041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.321846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.322289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.382536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:10.390543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f297f33f-e5fb-4f3b-83eb-047a784168c1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080783 Aug 02 09:38:10.391120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1295/2358] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:10.822551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:10.823242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:10.829241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.829696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.830458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.830896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.959107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:10.967386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85cd8b5d-c8e3-40a9-aca4-9736f299aa79 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148755 Aug 02 09:38:10.967956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1296/2359] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:10.973380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:10.973996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:10.979815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.980271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:10.981035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:10.981499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:11.109295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:11.117403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-16e332e2-1082-4e45-883a-a74b143a70ad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148470 Aug 02 09:38:11.119172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1297/2360] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:11.320415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:11.321056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:11.328381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:11.328920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:11.330352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:11.330794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:11.392812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:11.401734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:11.403268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:11.404409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-051549a8-81d2-4e85-80e8-be094d4ea2bb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087937 Aug 02 09:38:11.404979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1298/2361] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:11.410452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:11.411067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:11.416939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:11.417423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:11.418197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:11.418642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:11.479018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:11.486884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa74c8e7-7a1d-46e0-b055-dad97fd586d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080012 Aug 02 09:38:11.487442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1299/2362] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:11.989584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:11.990212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:11.996292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:11.996745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:11.997643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:11.998082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.125159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:12.133616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c5a56dd5-f5ca-4169-82db-18e3079f84da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148022 Aug 02 09:38:12.134239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1300/2363] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:12.138871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:12.139480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:12.146135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:12.146587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.147359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:12.147805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.278152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:12.286746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f508a1fb-3d67-4273-9230-15bb3bd8efd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151346 Aug 02 09:38:12.287322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1301/2364] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:12.426562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:12.427165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:12.433537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:12.433977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.434725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:12.435153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.496817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:12.500303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:12.506901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:12.508388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:12.509805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01a4878c-13df-434f-8306-d5ee06a5037c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087329 Aug 02 09:38:12.510365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1302/2365] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:12.514738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:12.515334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:12.522230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:12.522674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.523423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:12.523851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:12.584479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:12.591997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4c20c54d-a14f-4941-9c20-733200cb5950 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080682 Aug 02 09:38:12.592577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1303/2366] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:13.156270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:13.156910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:13.164045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.164494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.165294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.165733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.294648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:13.302991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5d70be6f-3764-4967-a535-b8bf6aadb4f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150626 Aug 02 09:38:13.303569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1304/2367] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:13.307992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:13.308601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:13.314485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.314940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.315728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.316147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.444812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:13.452771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2b07b669-407b-4095-b3d3-d5fb0b45bd86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148257 Aug 02 09:38:13.453363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1305/2368] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:13.532764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:13.533416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:13.546245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.546722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.547555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.548031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.609554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:13.618058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:13.619564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:13.620715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f23b58cb-ffcb-496f-99f5-48f68b3a82c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091844 Aug 02 09:38:13.621309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1306/2369] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:13.625673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:13.626281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:13.632667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.633138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.633899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:13.634334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:13.699185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:13.707375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5888b79-af10-404c-868a-71229b617b3d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085110 Aug 02 09:38:13.707950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1307/2370] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:14.324562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:14.325230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:14.331420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.331867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.332624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.333058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.461136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:14.469022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8dccddb9-f178-4cd3-a141-46bad894a33d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148382 Aug 02 09:38:14.469616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1308/2371] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:14.475439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:14.476147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:14.481865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.482314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.483073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.483507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.614638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:14.622566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6311c221-8c99-4ca2-b77d-406d139bbee8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150619 Aug 02 09:38:14.623139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1309/2372] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:14.644677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:14.645325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:14.651136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.651585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.652344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.652782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.713792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:14.723326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:14.724557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:14.725734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-46b30caa-0e11-402e-bf7f-df8d5da9169e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085292 Aug 02 09:38:14.726297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1310/2373] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:14.730744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:14.731347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:14.737104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.737577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.738334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:14.738764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:14.799391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:14.806845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da784013-4439-40c0-a012-4b31f0c9964d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079558 Aug 02 09:38:14.807409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1311/2374] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:15.490945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:15.491602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:15.498206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.498661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.499426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.499862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.627337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:15.635830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-26c935e2-1aa8-4525-b376-0dc33a521f1f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149476 Aug 02 09:38:15.636406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1312/2375] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:15.643377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:15.644468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:15.650286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.650732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.651481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.651909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.785104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:15.793697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d748a51c-25c6-48f1-a2c4-a404c423c66d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153813 Aug 02 09:38:15.797269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1313/2376] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:15.801993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:15.802627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:15.808678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.809153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.809944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.810379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.873148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:15.882983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:15.884734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:15.885897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-432ccbfe-7bb1-48d4-9744-7b3c7d3aaa12 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087655 Aug 02 09:38:15.886462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1314/2377] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:15.890955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:15.891560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:15.898290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.898731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.899482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:15.899914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:15.963943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:15.971622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95c56fee-6c06-4d1f-b626-6f47db68f4e5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084186 Aug 02 09:38:15.972283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1315/2378] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:16.657581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:16.658196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:16.664855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:16.665349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:16.666114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:16.666552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.020827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:17.028770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3d12475-c011-4986-b0ba-780013db56ed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.375109 Aug 02 09:38:17.029370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1316/2379] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:17.033811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:17.034522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:17.040656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:17.041101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.041890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:17.042326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.169214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:17.178506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b265d47-7ccd-46ae-8289-832f8a21ecdc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148098 Aug 02 09:38:17.179017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1317/2380] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:17.183588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:17.184198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:17.190017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:17.190466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.192406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:17.192849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.256228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:17.264726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:17.266291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:17.267489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3e53e223-bad7-477f-aa17-da3dd9b6a6a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087521 Aug 02 09:38:17.268056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1318/2381] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:17.272781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:17.273423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:17.279113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:17.279566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.280331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:17.280781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:17.299074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:17.342837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:17.350979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19b1bda6-a9b0-4104-85e5-f04065277d1e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081977 Aug 02 09:38:17.351554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1319/2382] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:18.007602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:18.050910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:18.051534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:18.058024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.058467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.059221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.059658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.190078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:18.198145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d3af8ddd-3288-4140-a6e7-42c15f6a2b36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151917 Aug 02 09:38:18.198716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1320/2383] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:18.203142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:18.203749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:18.206501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:18.210081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.210530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.211303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.212426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.342724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:18.352031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b1e2bfac-8c62-4b66-9739-4557045314b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152369 Aug 02 09:38:18.352616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1321/2384] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:18.357041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:18.357677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:18.363785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.364235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.365005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.365467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.427117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:18.435432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:18.436948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:18.438178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-25941670-4b82-449a-9ed0-0a6d59d6b470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084564 Aug 02 09:38:18.438691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1322/2385] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:18.443364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:18.443979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:18.449837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.450293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.451055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:18.451494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:18.511895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:18.519825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-692e4f14-e923-467f-8d04-a79b50e25164 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080182 Aug 02 09:38:18.520410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1323/2386] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:19.220064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:19.220698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:19.227986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.228428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.229207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.229634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.358869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:19.367516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40cfd3d8-7354-4878-9254-53afb359247d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151477 Aug 02 09:38:19.368474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1324/2387] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:19.373009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:19.373638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:19.379743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.380270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.381086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.381608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.507553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:19.515691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b4589e1d-9a5e-4ed5-82e4-5075f5a668e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146204 Aug 02 09:38:19.516257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1325/2388] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:19.521367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:19.521934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:19.527488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.527931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.528684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.529131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.590142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:19.598645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:19.600149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:19.601328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4fdb2842-a60d-491c-86fa-a17bd171dd36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084125 Aug 02 09:38:19.601891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1326/2389] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:19.606233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:19.606839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:19.612527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.613192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.613904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:19.614340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:19.674383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:19.681901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a42a573-8838-4161-b128-560a7fe420ae tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079057 Aug 02 09:38:19.682473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1327/2390] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:20.389737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:20.390415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:20.396857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.397356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.398136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.398571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.531887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:20.539815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ae080eb1-bc94-4962-be71-c16fbf1053cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154011 Aug 02 09:38:20.541141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1328/2391] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:20.545628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:20.546238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:20.551981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.552427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.553206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.553640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.681154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:20.689025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-07c46d22-8eac-4ef9-91b9-23c3399e18b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146862 Aug 02 09:38:20.689671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1329/2392] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:20.694082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:20.694679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:20.700582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.701026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.701839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.702270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.771618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:20.781070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:20.782585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:20.783738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-10a30bdc-bab7-49a2-88cf-0ef413324225 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093118 Aug 02 09:38:20.784297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1330/2393] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:20.788579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:20.789203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:20.795935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.796446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.797277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:20.797726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:20.858596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:20.866085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6ea7d566-57b9-4a15-8c53-68a2ac1e8a2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080847 Aug 02 09:38:20.866658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1331/2394] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:21.562905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:21.563594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:21.570073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.570527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.571429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.572500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.699614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:21.707678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab6ef327-bae4-4b32-8353-e0a7e8055693 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148678 Aug 02 09:38:21.708246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1332/2395] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:21.712618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:21.713235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:21.718900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.719348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.720098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.720530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.851935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:21.860649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ca93f75a-29e7-4e82-8c76-1f8096c3da90 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151458 Aug 02 09:38:21.861253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1333/2396] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:21.865674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:21.866287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:21.872562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.873014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.873812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.874261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.936697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:21.945282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:21.947513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:21.948662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45898d7e-aef0-4259-91e8-effeed12f782 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086477 Aug 02 09:38:21.949326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1334/2397] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:21.953653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:21.954263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:21.959999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.960455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:21.961248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:21.961686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:22.022631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:22.030465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-55a7bc69-a209-4a31-a461-200c04d53f0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080193 Aug 02 09:38:22.031032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1335/2398] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:22.729165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:22.729780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:22.736542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:22.736992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:22.737790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:22.738226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:22.742221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:22.870385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:22.878322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d621b1cf-80b3-4825-b093-2f8f62e74ac1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153043 Aug 02 09:38:22.878894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1336/2399] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:22.883244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:22.884768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:22.890516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:22.890973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:22.891779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:22.892251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:23.024950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:23.033216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a4b26c70-8a35-4764-9633-046b18225896 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153318 Aug 02 09:38:23.033799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1337/2400] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:23.038376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:23.039007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:23.044998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:23.045486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:23.046355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:23.046798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:23.108379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:23.116770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:23.119027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:23.120120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7cf85d66-c2c7-4c1b-a2ce-1c8f67787d0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085390 Aug 02 09:38:23.120690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1338/2401] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:23.125163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:23.125773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:23.131437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:23.131889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:23.132650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:23.133091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:23.194044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:23.201774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d9496f19-c144-40fe-b5eb-87bf5430fff4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080080 Aug 02 09:38:23.202349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1339/2402] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:23.901569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:23.902254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:23.908952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:23.909436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:23.910213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:23.910653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.045257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:24.053209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e2f34777-776f-444a-b6d0-dff43f41321b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156551 Aug 02 09:38:24.053783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1340/2403] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:24.058222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:24.058864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:24.064523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:24.064969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.065758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:24.066196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.194503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:24.203333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-22b58543-e0d8-4e2b-9738-e24b51c052f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148581 Aug 02 09:38:24.203904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1341/2404] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:24.208297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:24.208903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:24.214972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:24.215431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.216195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:24.216658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.281456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:24.289852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:24.291435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:24.292583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-627831d4-f7bb-4c2a-9d78-abd59ce4bb78 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087758 Aug 02 09:38:24.293162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1342/2405] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:24.297527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:24.298134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:24.303773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:24.304224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.304985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:24.305458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:24.365824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:24.373953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d601b51-e593-4efe-8487-062dc2c73947 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079843 Aug 02 09:38:24.374531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1343/2406] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:25.077012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:25.077726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:25.084147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.084593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.085370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.085801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.217673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:25.228559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-50bd37e7-272b-460c-ab4f-c15bcfb0ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154707 Aug 02 09:38:25.229536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1344/2407] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:25.234066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:25.234686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:25.240645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.241089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.241890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.242327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.373748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:25.381753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-388bb195-338f-45a6-9754-7763a2c75047 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151288 Aug 02 09:38:25.382322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1345/2408] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:25.387140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:25.387750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:25.393614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.394061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.394828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.395272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.456083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:25.464505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:25.466001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:25.467145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-069fb819-da4d-4dbe-8bee-9de91c37a34e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083900 Aug 02 09:38:25.467710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1346/2409] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:25.472323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:25.472934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:25.479201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.479644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.480407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:25.480844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:25.541651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:25.549266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-31f43443-04b4-4e4b-accb-8f5155a60856 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080375 Aug 02 09:38:25.549840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1347/2410] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:26.253644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:26.254300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:26.262145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.262766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.263853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.264406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.398157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:26.406379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-82358f2a-3899-4b30-acf7-fbd8e437d05f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157009 Aug 02 09:38:26.406954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1348/2411] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:26.411341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:26.411946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:26.418358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.418813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.419614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.420056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.550112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:26.558251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a4169894-58f8-4213-ba64-c2ba084536e7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150350 Aug 02 09:38:26.558829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1349/2412] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:26.563234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:26.565020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:26.569947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.570396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.571339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.572266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.633219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:26.642200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:26.643702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:26.644837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b019f16-27ba-4fb4-bd83-7463fd7a3426 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085088 Aug 02 09:38:26.645435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1350/2413] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:26.650979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:26.651596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:26.657249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.657699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.658453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:26.658886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:26.720664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:26.729319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e87ec3e3-f2cc-4aef-9391-5e7755077e83 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082901 Aug 02 09:38:26.729892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1351/2414] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:27.428479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:27.429210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:27.436274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.436719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.437515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.437952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.569534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:27.574198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:27.579537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d53f0684-449e-462c-a925-6a7487faa514 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154987 Aug 02 09:38:27.580108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1352/2415] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:27.584652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:27.585284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:27.591682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.592126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.592876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.593335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.721812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:27.730585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0caaf205-100b-4997-b317-d587101e94bc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149530 Aug 02 09:38:27.731152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1353/2416] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:27.735894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:27.736532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:27.742484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.742942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.744298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.744738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.809737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:27.817993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:27.819485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:27.820715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-31381e64-abd1-4811-9758-e4bbad7ecdd1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088627 Aug 02 09:38:27.821412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1354/2417] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:27.826001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:27.826607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:27.832943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.832943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.833761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:27.834195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:27.894743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:27.902356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8dd080c-4c63-4e2c-8dce-76fa9652777c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079895 Aug 02 09:38:27.902928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1355/2418] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:28.600340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:28.600808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:28.609044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:28.609535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:28.610308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:28.610744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:28.741014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:28.749223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ce7b028c-f6a8-4656-8a87-d99835a9f124 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153063 Aug 02 09:38:28.749837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1356/2419] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:28.754245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:28.754853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:28.761620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:28.761998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:28.762764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:28.763199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:28.896671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:28.906227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f5ff9d18-8d38-4f44-add7-040a5512e35b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155358 Aug 02 09:38:28.909165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1357/2420] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:28.911335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:28.911954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:28.920391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:28.920849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:28.921663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:28.922201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:28.986264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:28.995089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:28.996606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:28.997790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3ecc26d8-c45d-4851-b766-53c5d5b30aa2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090042 Aug 02 09:38:28.998364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1358/2421] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:29.002722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:29.003332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:29.009309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:29.009863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:29.010629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:29.011068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:29.072523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:29.080121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2dba2c26-cb7c-41aa-b641-a1f602f8394d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080814 Aug 02 09:38:29.080699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1359/2422] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:29.771068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:29.771758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:29.778421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:29.778866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:29.779616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:29.780048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:29.911716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:29.920548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4dae005-6e8a-41b7-a6f6-ea0d66aa9203 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153447 Aug 02 09:38:29.921373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1360/2423] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:29.928206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:29.928808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:29.935533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:29.935977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:29.936795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:29.937258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:30.066448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:30.074438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-51870340-5bcb-427e-9aef-5a8cd99c8826 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149791 Aug 02 09:38:30.074994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1361/2424] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:30.079347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:30.079942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:30.085419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:30.085863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:30.086630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:30.087063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:30.148467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:30.156951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:30.158475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:30.159606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a3d8bbb-d0a8-4580-bd4d-ddf1f6c5b246 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083707 Aug 02 09:38:30.160161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1362/2425] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:30.164464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:30.166222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:30.171883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:30.172376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:30.173075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:30.173529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:30.234385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:30.241881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33b07a84-224d-4857-916d-ed58126395d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080782 Aug 02 09:38:30.242454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1363/2426] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:30.942727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:30.943358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:30.950767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:30.951219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:30.951989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:30.952427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.084466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:31.092636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-05bdf11b-5a92-4f16-abe3-2e4d09aca2af tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153786 Aug 02 09:38:31.093223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1364/2427] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:31.097641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:31.098245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:31.104138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:31.104590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.105389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:31.105826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.236039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:31.244702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11872011-44f3-4a89-82f5-1946d04a02e1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150542 Aug 02 09:38:31.245328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1365/2428] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:31.249826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:31.250423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:31.256075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:31.256714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.257557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:31.257998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.325598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:31.334239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:31.335738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:31.337613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ae4c6123-cb7b-47c1-bcc6-6e302627615c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090641 Aug 02 09:38:31.338299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1366/2429] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:31.342700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:31.343302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:31.349169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:31.349616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.350359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:31.350788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:31.411699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:31.420073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a439d30b-a9ae-4445-bbd7-091993dd84ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080829 Aug 02 09:38:31.420649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1367/2430] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:32.114125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:32.114788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:32.121551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.122006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.122775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.123214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.250015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:32.257998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f2c86f6-c36e-48f0-b4a0-b275233bb172 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147857 Aug 02 09:38:32.259855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1368/2431] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:32.267097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:32.267710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:32.273609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.274674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.275447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.275886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.294108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:32.408222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:32.416229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0ec0c959-5ccc-4e62-8e34-06735a5d2080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152709 Aug 02 09:38:32.416798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1369/2432] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:32.421168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:32.421765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:32.427343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.427787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.428532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.428961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.490537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:32.499511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:32.501003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:32.502163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83bae71f-6256-47a7-9a38-a781a29657f8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084426 Aug 02 09:38:32.502714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1370/2433] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:32.507007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:32.507603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:32.511222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:32.515554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.515997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.516752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:32.517239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:32.578571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:32.586209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a578d719-c941-4161-bd50-3eacfa92e5ba tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082564 Aug 02 09:38:32.587094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1371/2434] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:33.280412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:33.281047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:33.287607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.288058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.288821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.289292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.426212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:33.434521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4f813830-e84f-47cc-9540-d4e783308e15 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158022 Aug 02 09:38:33.435101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1372/2435] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:33.439640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:33.440252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:33.446040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.446455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.447215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.447655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.576152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:33.584228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ede0b3e-227f-4e11-abfe-b00eb25060b3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148176 Aug 02 09:38:33.584801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1373/2436] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:33.589787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:33.590397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:33.596042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.596493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.597286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.597729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.659776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:33.668993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:33.670539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:33.671682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-97812e11-a644-4f14-a589-1a205de20a6e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085930 Aug 02 09:38:33.672255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1374/2437] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:33.676621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:33.677349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:33.683384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.683837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.684611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:33.685049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:33.750132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:33.757583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ef68dfd1-d089-469d-bfdc-4c245d112fbf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084349 Aug 02 09:38:33.758155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1375/2438] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:34.456176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:34.456821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:34.463565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.464017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.464783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.465256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.596158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:34.604614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ca86cef4-7578-4496-b886-4d4611d93b01 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152444 Aug 02 09:38:34.606538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1376/2439] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:34.610104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:34.610723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:34.616577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.617026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.618417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.618936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.746796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:34.754709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0cd5cfd1-93e3-4371-a4e5-83a4d785a10d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148501 Aug 02 09:38:34.755283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1377/2440] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:34.759923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:34.760531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:34.766146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.766636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.767424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.767839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.832124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:34.841134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:34.842670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:34.843826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f4a30460-6697-461a-8b4b-bc45c1cc9f62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087612 Aug 02 09:38:34.844461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1378/2441] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:34.848819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:34.849454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:34.855729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.856174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.856939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:34.857401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:34.918964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:34.926669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-28b0687b-80fe-48e3-bf20-fa5e53f645a8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081254 Aug 02 09:38:34.927241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1379/2442] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:35.627260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:35.627962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:35.634921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:35.635374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:35.636135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:35.636573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:35.764644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:35.772643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7f28a350-9850-4c58-9e30-ae808d7253ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149383 Aug 02 09:38:35.774360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1380/2443] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:35.778788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:35.779398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:35.785170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:35.785627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:35.786391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:35.786838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:35.919374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:35.927463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-24914e2b-7f57-4cc3-9c71-9cc313f81b33 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152147 Aug 02 09:38:35.928040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1381/2444] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:35.932824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:35.933465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:35.939100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:35.939552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:35.940319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:35.940758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:36.002288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:36.011802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:36.013357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:36.014496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-70470440-34e5-4226-8343-b22628393045 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085538 Aug 02 09:38:36.015066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1382/2445] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:36.019389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:36.019995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:36.026570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:36.027025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:36.027785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:36.028218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:36.088909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:36.096285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-792c0eff-5ccb-4bab-939c-2ea20f2d6ff1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080280 Aug 02 09:38:36.096884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1383/2446] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:36.795923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:36.796583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:36.803245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:36.803694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:36.804459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:36.804892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:36.937383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:36.945398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-434a3221-5dbe-4e30-a102-753976acb471 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153360 Aug 02 09:38:36.946689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1384/2447] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:36.951427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:36.952041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:36.958073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:36.958520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:36.959290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:36.959726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:37.088193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:37.096117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fbb904c8-2565-4f12-986e-1eccf0712f92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148273 Aug 02 09:38:37.096697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1385/2448] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:37.101077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:37.101710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:37.107397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:37.107852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:37.108620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:37.109055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:37.113319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:37.170708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:37.179038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:37.181135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:37.182283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-889850f6-8d6e-4c7b-8d7c-0078533689a2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084635 Aug 02 09:38:37.182851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1386/2449] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:37.187246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:37.187853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:37.193577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:37.194032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:37.194798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:37.195237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:37.255414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:37.264092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-25377836-7b6a-4cc3-80cf-942322703652 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080289 Aug 02 09:38:37.264670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1387/2450] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:37.968089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:37.968803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:37.975378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:37.975826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:37.976584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:37.978185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.109494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:38.118820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da541d3d-ae22-4e81-a662-95c4a806dab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153422 Aug 02 09:38:38.119491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1388/2451] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:38.124039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:38.124751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:38.130491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:38.130936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.131688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:38.132120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.261148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:38.269014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5669478e-4232-424f-bd38-ed563af0ba64 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148558 Aug 02 09:38:38.269644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1389/2452] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:38.274685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:38.275468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:38.281225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:38.281675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.282437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:38.282871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.346273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:38.354996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:38.356500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:38.357682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b8155f0a-bf24-41cf-a8a8-2944123d70cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087098 Aug 02 09:38:38.358239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1390/2453] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:38.362573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:38.363177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:38.368814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:38.369303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.370064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:38.370499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:38.432238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:38.439778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-292011b0-ee3e-4293-b9cb-6e39b9d6147c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080591 Aug 02 09:38:38.440354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1391/2454] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:39.140285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:39.140961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:39.147459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.147907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.148667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.149129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.279932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:39.287971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1a09c094-8f95-428c-8e92-3590d11f14f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151738 Aug 02 09:38:39.288541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1392/2455] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:39.293776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:39.294381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:39.300042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.300487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.301267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.301709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.433060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:39.440944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f47598c9-da0a-40ba-a4d2-31806f6914ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151451 Aug 02 09:38:39.441553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1393/2456] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:39.446053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:39.446673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:39.452310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.452751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.453548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.453978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.514844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:39.523495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:39.525778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:39.526924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e4acabf2-13c7-4368-a497-1d8f32485b3c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084384 Aug 02 09:38:39.527489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1394/2457] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:39.531916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:39.532523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:39.538298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.538742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.539501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:39.539935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:39.600953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:39.608721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6485eacb-88d1-4092-93c1-ffff4b2d9032 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080284 Aug 02 09:38:39.609330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1395/2458] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:40.310702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:40.311350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:40.317890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.318339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.319102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.319651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.450530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:40.458563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b1c63399-7ab4-4071-8d02-722cbacd07d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151837 Aug 02 09:38:40.459130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1396/2459] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:40.463893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:40.464494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:40.470217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.470664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.471425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.471867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.599164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:40.608221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-372e8562-28f0-4712-a9c1-b973f0b63e6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148124 Aug 02 09:38:40.608798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1397/2460] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:40.613454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:40.614050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:40.620488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.620932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.621775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.622208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.682440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:40.690842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:40.692348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:40.693546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4b06a951-608a-45f4-9aee-5b6161147213 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083762 Aug 02 09:38:40.694118 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1398/2461] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:40.698681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:40.699278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:40.705130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.705589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.706382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:40.706820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:40.768187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:40.776860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2b0eee43-2b1e-41f4-b0e8-10761489fb1d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081775 Aug 02 09:38:40.777485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1399/2462] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:41.480199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:41.480815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:41.487629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.488081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.488840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.489314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.623562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:41.631859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b52e846-8641-4ed0-a429-c34a6dd4ef33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155910 Aug 02 09:38:41.632436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1400/2463] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:41.637833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:41.638488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:41.644139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.644587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.645382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.645822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.773507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:41.781756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0fd83e23-7df1-4109-aa6d-7b11d59b8ae5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148305 Aug 02 09:38:41.782308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1401/2464] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:41.786985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:41.787594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:41.794063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.794519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.795289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.795727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.859479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:41.862857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:41.868154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:41.870726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:41.871874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c345f2b4-6061-417d-a79f-6c0712b94e31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088641 Aug 02 09:38:41.872437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1402/2465] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:41.877146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:41.877785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:41.883753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.884957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.885819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:41.886265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:41.949203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:41.956737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-116f54ec-9f9f-411a-964f-3e56b558242d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083361 Aug 02 09:38:41.957386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1403/2466] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:42.654586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:42.655211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:42.661873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:42.662326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:42.663088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:42.663526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:42.790151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:42.798752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c25d6aa3-51ac-4ded-833b-d03b39e6a1aa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148663 Aug 02 09:38:42.799321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1404/2467] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:42.803766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:42.804374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:42.810575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:42.811024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:42.811784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:42.812220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:42.943003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:42.951766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83d2faee-8e80-49bd-b9c6-018951f6126b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151498 Aug 02 09:38:42.952337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1405/2468] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:42.956793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:42.957435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:42.964080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:42.964448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:42.965391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:42.965943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:43.030043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:43.038490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:43.039998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:43.041308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6724d02-f080-44bf-ac8c-cc93b9a9f048 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087880 Aug 02 09:38:43.042008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1406/2469] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:43.046342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:43.046948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:43.052506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:43.052951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:43.053818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:43.054256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:43.114968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:43.122891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-63581f9d-22f1-4cb7-bf69-7646f02c4c5c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079918 Aug 02 09:38:43.123455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1407/2470] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:43.820528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:43.821234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:43.828422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:43.828856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:43.829644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:43.830080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:43.962645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:43.970693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fee9cafc-23d2-41f2-884a-c9f2294ec00b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154084 Aug 02 09:38:43.971258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1408/2471] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:43.975597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:43.976194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:43.982015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:43.982457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:43.983314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:43.983643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:44.112836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:44.121508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6d6f5d16-7eb7-42af-bda6-bc1dd2c91f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149287 Aug 02 09:38:44.122076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1409/2472] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:43 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:44.126618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:44.127214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:44.132707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:44.133211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:44.133963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:44.134645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:44.195341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:44.203759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:44.205278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:44.206408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d142faca-7597-438f-b4c7-43adcbcb3763 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083419 Aug 02 09:38:44.206970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1410/2473] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:44.211342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:44.211937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:44.218219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:44.218678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:44.219456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:44.219941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:44.280492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:44.287964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2877a8cd-af06-4c7b-a7c9-9ce516711722 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080054 Aug 02 09:38:44.288535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1411/2474] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:44.991919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:44.992541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:44.999820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.000271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.001018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.001470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.130877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:45.139663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9777c78-0762-4e88-829e-66844eaa9dc0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151705 Aug 02 09:38:45.140230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1412/2475] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:45.144587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:45.145221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:45.151655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.152101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.152862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.153325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.280908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:45.288848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-67301db8-9a1b-42ee-88b6-0f86be926e87 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147678 Aug 02 09:38:45.289448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1413/2476] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:45.294053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:45.294651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:45.300134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.300577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.301356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.301790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.365734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:45.375030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:45.376522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:45.377692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6aa3245e-4d98-4c09-a9e6-b1f19db34aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087342 Aug 02 09:38:45.378254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1414/2477] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:45.382646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:45.383250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:45.390059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.390510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.391295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:45.391725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:45.453278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:45.460758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54ff6335-8508-4e48-b4ef-b5f2092ce76f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081560 Aug 02 09:38:45.461366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1415/2478] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:46.161725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:46.162367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:46.169003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.169477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.170230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.170660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.300742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:46.309662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-23fb1dba-49b1-4f6b-9cf0-1e67dd3ffbf7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151833 Aug 02 09:38:46.310235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1416/2479] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:46.314833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:46.315439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:46.321171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.321625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.322421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.322855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.453626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:46.461559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dde913f-e6ee-4be3-a20d-74719ee842df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150295 Aug 02 09:38:46.462132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1417/2480] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:46.466902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:46.467612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:46.473448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.473901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.474659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.475106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.536931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:46.545984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:46.547485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:46.548615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf4b809c-830c-488c-835f-5066373fda7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085539 Aug 02 09:38:46.549185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1418/2481] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:46.553504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:46.554103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:46.561170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.561639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.562402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:46.562840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:46.581131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:46.626990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:46.635217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2f179728-7a4d-40b2-9944-544f4cbcb868 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084389 Aug 02 09:38:46.635641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1419/2482] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:47.331869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:47.332537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:47.339098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.339550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.340312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.340754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.473206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:47.481977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30feb9a9-84ae-4167-bc06-df29fe59891a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153984 Aug 02 09:38:47.482527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1420/2483] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:47.488123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:47.488772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:47.491859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:47.497515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.497984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.498825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.499256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.631776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:47.640765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ce7abb6c-d7e1-4e32-97b9-f54c596768e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157298 Aug 02 09:38:47.641370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1421/2484] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:47.645931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:47.646547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:47.652320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.652766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.653567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.654008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.714960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:47.723393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:47.724906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:47.726090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e217665-87bb-4b22-b364-6d2a69130301 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083800 Aug 02 09:38:47.726664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1422/2485] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:47.731627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:47.732234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:47.738087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.738540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.739304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:47.739743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:47.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:47.808528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-abb3353a-73f5-4d57-b35c-896b7e3514ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080357 Aug 02 09:38:47.809135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1423/2486] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:48.504474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:48.505174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:48.512467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.512911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.513695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.514127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.643800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:48.652338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3201b329-e2f4-43e1-8926-5a58f55ebca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151688 Aug 02 09:38:48.652871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1424/2487] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:48.662228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:48.662866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:48.668763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.669563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.670865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.671827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.799381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:48.807347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45f13907-06d0-4c9f-8fad-a4854ec18e4b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148753 Aug 02 09:38:48.808721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1425/2488] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:48.813051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:48.813679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:48.819280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.819727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.820479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.820917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.884882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:48.893304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:48.894813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:48.895962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9732fd88-7089-4f78-9f52-17e4053b046e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086379 Aug 02 09:38:48.896524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1426/2489] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:48.900834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:48.902059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:48.908248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.908701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.909500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:48.909982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:48.971027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:48.978549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f41e1db6-8d76-4128-ad3e-1f863f8c92a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081089 Aug 02 09:38:48.979123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1427/2490] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:49.673879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:49.674573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:49.682172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:49.683011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:49.684235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:49.684700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:49.816768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:49.824965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0b0d27c-66e3-4a29-968c-8fcbd3c1e7ac tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154934 Aug 02 09:38:49.825576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1428/2491] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:49.830020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:49.830633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:49.836323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:49.836770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:49.837556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:49.838013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:49.971995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:49.981340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db5fcb16-343f-40d4-9ce3-0cdd56b18ebd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154753 Aug 02 09:38:49.981930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1429/2492] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:49.986531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:49.987138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:49.993166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:49.993632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:49.994408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:49.994873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:50.056077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:50.064722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:50.066273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:50.067416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72d1807d-5955-44e7-89e3-530ba69536b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084560 Aug 02 09:38:50.067985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1430/2493] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:50.072321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:50.072935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:50.079321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:50.079771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:50.080537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:50.080979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:50.141484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:50.148908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8ed4f915-916e-4bb7-b994-2af35e3ace81 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079980 Aug 02 09:38:50.149509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1431/2494] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:50.845876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:50.846543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:50.853059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:50.853542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:50.854837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:50.855524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:50.988047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:50.997151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-046a439b-51cb-4df2-b0cb-55a83a48b560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155221 Aug 02 09:38:50.997838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1432/2495] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:51.002244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:51.002848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:51.008661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:51.009101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:51.010156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:51.010649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:51.136599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:51.144508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da3451dc-1af1-492a-8168-feb5dccde162 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.145730 Aug 02 09:38:51.145069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1433/2496] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:50 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:51.149427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:51.150034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:51.156075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:51.156521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:51.157297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:51.157729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:51.218868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:51.227304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:51.228800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:51.230798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0dcb2e52-42be-4be2-b22e-2f8d8749018b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084648 Aug 02 09:38:51.231357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1434/2497] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:51.235629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:51.236227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:51.241824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:51.242265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:51.243014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:51.243442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:51.305098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:51.312811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-14c20116-78da-422a-b697-d7cd80053f87 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080501 Aug 02 09:38:51.313414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1435/2498] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:52.019191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:52.019842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:52.026358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.026843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.027756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.028242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.032166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:52.163492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:52.171796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c16c329a-86e6-4877-bc6e-8b0f431da70f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156496 Aug 02 09:38:52.172373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1436/2499] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:52.177395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:52.178025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:52.184451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.185307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.186077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.186520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.316539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:52.324766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2e521abc-d8f1-417c-a88d-0809595e33bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151388 Aug 02 09:38:52.325374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1437/2500] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:52.329932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:52.330540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:52.336298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.336751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.337543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.337983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.401668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:52.410387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:52.411935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:52.413084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ea39f36-601c-42c1-b642-95a55af1d8a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086784 Aug 02 09:38:52.413688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1438/2501] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:52.418548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:52.419155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:52.424739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.425222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.425985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:52.426424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:52.487030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:52.494593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6f04a329-e5b6-4bf6-94df-6c5e8e277a58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079957 Aug 02 09:38:52.495170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1439/2502] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:53.194577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:53.195208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:53.201959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.202402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.203152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.203583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.331829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:53.340274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d423f3a4-7937-4900-ab5b-83628c303300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149657 Aug 02 09:38:53.340848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1440/2503] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:53.346441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:53.347103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:53.353001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.353615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.354496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.355553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.485447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:53.493344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-08b391ef-5b3e-4d81-b3d7-1311fc98b880 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150443 Aug 02 09:38:53.493921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1441/2504] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:53.498531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:53.499138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:53.504829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.505331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.506093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.506536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.567918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:53.576527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:53.578050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:53.579179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3a84aa96-217e-41a2-bcf8-87e353300e84 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084343 Aug 02 09:38:53.579739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1442/2505] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:53.584022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:53.584620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:53.590889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.591333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.592082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:53.592510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:53.653422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:53.660862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff918a64-59af-4282-829e-451aa28a56ce tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080193 Aug 02 09:38:53.661459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1443/2506] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:54.470104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:54.470761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:54.476729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:54.477204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:54.477965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:54.478400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:54.609008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:54.616929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d65943f5-2b06-429c-afdf-d708b0d865d4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.259648 Aug 02 09:38:54.617539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1444/2507] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:54.732319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:54.732980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:54.738895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:54.739359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:54.740098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:54.740534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:54.868655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:54.876684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39887ce1-f0bb-41d1-8cd8-573e74930eed tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.258211 Aug 02 09:38:54.877342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1445/2508] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:54.993235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:54.993855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:55.000046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.000489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.001266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.001698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.063416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:55.071692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:55.073347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:55.074586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-000af7ae-2db7-425e-b8db-8ec4c5edc55a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.196324 Aug 02 09:38:55.075144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1446/2509] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:55.079457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:55.080065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:55.085707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.086151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.086895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.087323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.148397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:55.155823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8211570b-8b99-4ef2-b397-5bc3ee771e31 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079728 Aug 02 09:38:55.156371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1447/2510] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:55.639333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:55.640018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:55.646521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.646973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.647733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.648166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.779760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:55.787673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c6df094f-3f37-486f-956d-9ae725e44e6f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152333 Aug 02 09:38:55.788237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1448/2511] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:55.898172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:55.898707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:55.905462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.905934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:55.906697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:55.907126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.035957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:56.043821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bef575f8-e585-4216-b0c4-621aae3e976c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149460 Aug 02 09:38:56.044395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1449/2512] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:56.097395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:56.098004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:56.103772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:56.104228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.105222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:56.105664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.170766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:56.179218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:56.180715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:56.181889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0592355-e8c1-45c2-9b60-e039bfdf0b51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088101 Aug 02 09:38:56.182454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1450/2513] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:38:56.187000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:56.187604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:56.193262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:56.193713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.194465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:56.194898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.254974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:56.263321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa94e283-ed01-499f-977a-3a2ea581e2a6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079701 Aug 02 09:38:56.263898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1451/2514] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:56.809858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:56.810515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:56.817460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:56.817916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.818683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:56.819123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:56.947329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:56.950856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:38:56.956157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5fa1aaad-a27f-4852-8631-8c06d9fd1c11 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150253 Aug 02 09:38:56.956736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1452/2515] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:57.065250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:57.065793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:57.071903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.072354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.073129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.073600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.205029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:57.212969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0a4b429-6f92-4c8c-9f08-98485255588f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151675 Aug 02 09:38:57.213565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1453/2516] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:57.218567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:57.219165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:57.224776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.225258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.225983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.226412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.287009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:57.296776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:57.298382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:57.299711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19981aab-8fee-4244-be31-1bb83c08d2b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084619 Aug 02 09:38:57.300318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1454/2517] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:57.305001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:57.305642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:57.311423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.311872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.312632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.313070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.374768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:57.382350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1d127375-eaf7-4d8c-8546-cede00ac25ee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081078 Aug 02 09:38:57.382930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1455/2518] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:57.977490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:57.978123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:57.984436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.984888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:57.985694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:57.986129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.116228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:58.124066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3e40b2be-b7eb-490f-b75c-432e775182e2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150534 Aug 02 09:38:58.124641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1456/2519] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:58.234921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:58.235462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:58.241897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:58.242346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.243105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:58.243541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.370917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:58.378790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9e2ea43e-771d-40a9-8332-4522c927a354 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147637 Aug 02 09:38:58.379358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1457/2520] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:58.383796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:58.384658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:58.390963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:58.391405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.392155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:58.392583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.452871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:58.461225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:58.462743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:58.464650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5e4b8e76-325b-4bb8-a336-fbb3009fcc86 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083608 Aug 02 09:38:58.465335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1458/2521] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:58.469678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:58.470287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:58.475959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:58.476428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.477204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:58.477645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:58.539279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:58.547229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c786302a-6852-4578-93d8-9ea8f9d402de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080921 Aug 02 09:38:58.547787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1459/2522] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:38:59.145674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:59.146347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:59.152577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.153022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.153809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.154245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.286489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:59.294983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa1e6597-9bcb-4dfb-b566-1b23c896193f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153223 Aug 02 09:38:59.295556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1460/2523] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:59.400578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:59.401255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:59.408019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.408473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.409263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.409705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.536166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:59.544858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8800a2f7-4bc2-4608-acc7-374dd216ae65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148157 Aug 02 09:38:59.545467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1461/2524] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:38:59.549902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:59.550505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:59.556010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.556453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.557241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.557739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.620526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:59.629346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:59.630858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:59.632095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0b2c66b2-d5e0-458b-aaf0-a8c1ef374405 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085677 Aug 02 09:38:59.632668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1462/2525] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:38:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:38:59.637462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:38:59.638074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:38:59.643976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.644424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.645213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:38:59.645668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:38:59.709045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:38:59.716704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8c614159-0729-4b26-b5e7-e0a16f97c19b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083071 Aug 02 09:38:59.717298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1463/2526] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:38:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:00.317021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:00.317724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:00.324186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.324626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.325408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.325840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.453746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:00.461756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60994691-05ae-4059-926d-dda26d64d5c5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148648 Aug 02 09:39:00.462340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1464/2527] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:00.565798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:00.566441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:00.572440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.572873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.574262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.574714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.703857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:00.711784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-38e01f99-114d-4f48-990f-ad48a35a44f6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149726 Aug 02 09:39:00.712359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1465/2528] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:00.717546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:00.718157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:00.723868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.724355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.725135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.725581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.787057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:00.795430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:00.796946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:00.798150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bc0b7365-2ca6-450c-9ba8-86ef28ce91c9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084865 Aug 02 09:39:00.798716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1466/2529] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:00.803148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:00.803766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:00.809618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.810072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.810843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:00.811287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:00.871878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:00.879397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1bf7ee26-2ce5-4534-8773-c8e01cb71d44 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079732 Aug 02 09:39:00.879974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1467/2530] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:01.484092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:01.484728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:01.491279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.491730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.492493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.492930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.623799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:01.631669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-373a9442-fe68-413a-9d94-9f1dc247bbd7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151709 Aug 02 09:39:01.632245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1468/2531] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:01.733328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:01.733942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:01.740000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.740455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.741247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.741687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.760239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:01.875026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:01.883343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d4bc8f22-79d4-4364-916a-26a196a46695 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153939 Aug 02 09:39:01.883923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1469/2532] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:01.889749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:01.890854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:01.896574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.897022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.897883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.898325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.959915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:01.968630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:01.970160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:01.971304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-65e589b7-1826-478b-b663-991a0f86528d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086204 Aug 02 09:39:01.971872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1470/2533] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:01.976260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:01.976858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:01.979528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:01.983860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.984312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:01.985076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:01.985603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:02.046270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:02.053762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e3c242a4-262e-4c3d-9b73-ba30da6c0fee tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080950 Aug 02 09:39:02.054364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1471/2534] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:02.660269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:02.660888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:02.668202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:02.668657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:02.669452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:02.669889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:02.800923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:02.809868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ed719efc-abdf-4fea-a331-57ab46354c95 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153490 Aug 02 09:39:02.810439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1472/2535] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:02.907155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:02.907702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:02.913730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:02.914181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:02.914947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:02.915386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.046618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:03.054595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6a9a3d1e-a779-4375-85d2-2b1dc1c19151 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151288 Aug 02 09:39:03.055177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1473/2536] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:03.059656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:03.060260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:03.065904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:03.066361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.067125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:03.067564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.131448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:03.140993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:03.142541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:03.143695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bb196b4b-3658-4d2e-9bc4-a339337bc4f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087596 Aug 02 09:39:03.144264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1474/2537] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:03.148592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:03.149228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:03.154959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:03.155411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.156174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:03.156614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.217157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:03.224648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41417910-b1d2-45e7-b759-befa4314addc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079443 Aug 02 09:39:03.225244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1475/2538] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:03.831903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:03.832580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:03.839820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:03.840276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.841040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:03.841525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:03.969763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:03.977687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2655836b-dbf0-45a7-88e3-89d6ca7a2360 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149695 Aug 02 09:39:03.978275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1476/2539] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:04.076447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:04.077051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:04.083088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:04.083474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:04.084225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:04.084660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:04.214871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:04.222788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-04da5d58-79af-46b4-97ca-af2868033599 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150846 Aug 02 09:39:04.223362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1477/2540] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:04.227761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:04.228367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:04.234580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:04.235036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:04.235806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:04.236245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:04.297686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:04.306090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:04.307611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:04.309412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a02379e3-bbfb-4383-83e2-ed4e2939629a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085076 Aug 02 09:39:04.309983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1478/2541] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:04.314351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:04.314964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:04.320731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:04.321212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:04.321977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:04.322418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:04.382937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:04.391405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0fa75766-0146-4774-b229-82296e34a09d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080480 Aug 02 09:39:04.391965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1479/2542] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:05.000536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:05.001190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:05.007732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.008183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.008942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.009683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.140606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:05.148477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-55d93067-83d1-4088-9a7d-c1b5764b4102 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152555 Aug 02 09:39:05.149043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1480/2543] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:05.244274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:05.244816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:05.251498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.251939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.252689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.253166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.599591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:05.607867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4d53dc03-42af-4a5f-9f74-90e90912f892 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.367318 Aug 02 09:39:05.608447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1481/2544] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:05.612850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:05.613544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:05.619023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.619476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.620233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.620667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.682715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:05.691561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:05.693049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:05.694204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f6629faf-fa82-4f81-9529-ecd2d6601c05 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084845 Aug 02 09:39:05.694758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1482/2545] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:05.699041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:05.700355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:05.705899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.706342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.707091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:05.707520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:05.769345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:05.777013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34ae2f14-95ef-4e39-a42c-3fc8a476b2f5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081303 Aug 02 09:39:05.777902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1483/2546] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:06.170393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:06.171031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:06.177725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.178106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.178858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.179285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.308147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:06.316641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3876b3b0-9dfb-4dbe-bb11-e674d971cbc8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150746 Aug 02 09:39:06.317236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1484/2547] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:06.629839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:06.630478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:06.636777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.637541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.638435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.638891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.767345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:06.775536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-44c5be8f-5364-49bc-9586-939493c33d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149621 Aug 02 09:39:06.776110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1485/2548] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:06.780600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:06.781247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:06.786831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.787284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.788039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.788474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.792732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:06.855173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:06.864221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:06.865804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:06.866945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-22cf4cdf-3ef9-42f2-a7ea-1537935ad23d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089884 Aug 02 09:39:06.867523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1486/2549] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:06.872190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:06.872723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:06.878393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.878842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.879602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:06.880042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:06.942119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:06.949649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-63b43923-1852-4189-a7cd-3e285891e706 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081183 Aug 02 09:39:06.950210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1487/2550] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:07.338324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:07.339014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:07.346158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:07.346609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:07.347371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:07.347818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:07.475985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:07.484030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4d131e53-4b76-4cec-91d5-85b11109fb5b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149658 Aug 02 09:39:07.484601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1488/2551] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:07.796818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:07.797459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:07.803656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:07.804299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:07.805070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:07.805544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:07.949793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:07.958148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dcb9ea03-7792-4116-852a-3c28ffa19515 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.165333 Aug 02 09:39:07.958725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1489/2552] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:07.963681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:07.965047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:07.971455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:07.971901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:07.972668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:07.973098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:08.043649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:08.052375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:08.053831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:08.055093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b98b1740-a068-4fbb-a143-c890a112c928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.095324 Aug 02 09:39:08.055898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1490/2553] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:08.061688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:08.062292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:08.068177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:08.068624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:08.069401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:08.069829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:08.135693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:08.144361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-abf11391-67a0-445f-8fa6-4aefc83b4f34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086930 Aug 02 09:39:08.144940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1491/2554] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:08.509776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:08.512693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:08.519181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:08.519634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:08.520402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:08.520839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:08.653246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:08.661440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-97c3aeca-c1cb-48c6-91e1-8df44f3d4ec2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159500 Aug 02 09:39:08.662004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1492/2555] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:08.983062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:08.983683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:08.989680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:08.990131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:08.990887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:08.991319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.120250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:09.128473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3101d284-64e9-4baa-a2f3-5ec55df36fb5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149566 Aug 02 09:39:09.129041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1493/2556] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:09.133444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:09.134084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:09.139978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:09.140426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.141207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:09.141645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.201416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:09.209761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:09.211266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:09.212400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ef8070e-c8d8-4cd7-9287-4b27edb2ebb0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.082423 Aug 02 09:39:09.212964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1494/2557] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:09.221024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:09.221024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:09.224280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:09.224900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.225707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:09.226128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.286276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:09.294433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cbf17279-4293-4997-ba19-6f2aff2a25b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080489 Aug 02 09:39:09.295002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1495/2558] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:09.684006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:09.684775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:09.691560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:09.692146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.692940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:09.695314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:09.830718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:09.838681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-162fbb46-37ea-4887-99ca-f84a61cee6bb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159058 Aug 02 09:39:09.839249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1496/2559] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:10.149848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:10.150483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:10.156585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.157028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.157803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.158235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.286278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:10.294820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-744c3cba-ab3f-4aa7-8c2d-b1c84f0c45b2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148847 Aug 02 09:39:10.295389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1497/2560] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:10.299797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:10.300390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:10.305920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.306362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.307187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.307617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.371766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:10.380063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:10.381576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:10.382693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-490956a1-e150-4023-9888-2340bea191c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086398 Aug 02 09:39:10.383255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1498/2561] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:10.388051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:10.388647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:10.394179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.394622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.395372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.395799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.456206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:10.463675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-809fc19a-2dc9-4fb9-b09d-80fb86ce557b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079486 Aug 02 09:39:10.464272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1499/2562] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:10.860507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:10.861231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:10.867787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.868236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.869003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:10.869473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:10.999847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:11.007982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9e0c127c-9333-48f7-96d7-78b261b69fa8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151616 Aug 02 09:39:11.008564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1500/2563] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:11.316158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:11.316869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:11.322891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:11.323338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:11.324922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:11.325395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:11.457381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:11.465441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2f64a03f-2b1c-481f-9666-cb78ce796ea6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153066 Aug 02 09:39:11.466020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1501/2564] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:11.470479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:11.471087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:11.476893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:11.477376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:11.478143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:11.478579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:11.539602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:11.543314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:11.549058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:11.550602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:11.551778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-422fc098-5849-4655-a09f-6d62c1321d85 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084838 Aug 02 09:39:11.552345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1502/2565] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:11.556855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:11.557494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:11.564305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:11.564754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:11.565540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:11.565980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:11.626212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:11.633675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30e64fd0-90de-4389-81a3-da35bb4d33c8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080377 Aug 02 09:39:11.634499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1503/2566] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:12.030233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:12.030893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:12.037385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.037829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.038579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.039011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.170856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:12.178792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6a9d5a9-9ce6-47b7-91bf-82e021d16666 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152387 Aug 02 09:39:12.179453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1504/2567] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:12.487232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:12.487766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:12.493835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.494292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.495055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.495497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.623466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:12.631468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d09f1e8b-3d25-40de-a511-88e219df359b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148196 Aug 02 09:39:12.632038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1505/2568] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:12.636808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:12.637496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:12.643192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.643736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.644571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.645086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.707746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:12.716789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:12.718342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:12.719473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f78aafb7-38c6-447c-a47c-9d990824dff5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086522 Aug 02 09:39:12.720030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1506/2569] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:12.724398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:12.724995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:12.731075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.731531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.732363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:12.732805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:12.793869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:12.801460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ade10907-30c1-47d4-aa20-e8fcf3709d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080435 Aug 02 09:39:12.802034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1507/2570] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:13.202297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:13.202940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:13.209473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.209928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.210694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.211130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.342940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:13.350829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7fcfa2cd-4e60-4e59-9b3d-a3f3a678120f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153111 Aug 02 09:39:13.351405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1508/2571] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:13.652475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:13.653202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:13.659248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.659701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.660467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.660907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.796135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:13.804164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b56d9aa6-fffd-4ec1-9271-35008eab5023 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156152 Aug 02 09:39:13.804732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1509/2572] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:13.809349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:13.809958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:13.815554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.816027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.816763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.817443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.883381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:13.892109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:13.893638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:13.894774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-054740a9-3fce-4594-b5b0-4c36832374c5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089103 Aug 02 09:39:13.895344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1510/2573] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:13.899671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:13.900280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:13.908377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.908759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.909553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:13.909992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:13.973410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:13.981005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b77f6d69-04b5-49da-951d-8b20709a95da tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084589 Aug 02 09:39:13.982448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1511/2574] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:14.372976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:14.373671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:14.380089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:14.380535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:14.381320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:14.381754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:14.510088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:14.518597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-def211d9-e522-4469-8652-06b831fba1ff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150080 Aug 02 09:39:14.519162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1512/2575] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:14.826337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:14.826985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:14.833157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:14.833619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:14.834382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:14.834819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:14.967390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:14.975322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c831239-270c-41b2-8cd4-a89d8f98ab46 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153517 Aug 02 09:39:14.975897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1513/2576] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:14.980359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:14.980953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:14.986509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:14.986950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:14.987981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:14.988406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:15.049840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:15.058859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:15.060576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:15.061770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5911a7ae-9e45-489d-b8bd-e90468613592 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084924 Aug 02 09:39:15.062336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1514/2577] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:15.066749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:15.067359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:15.073181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:15.073659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:15.075111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:15.075543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:15.135213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:15.143369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-395e4167-1cf3-4dfa-88b3-4093dd0b0eaf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080091 Aug 02 09:39:15.144230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1515/2578] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:15.539994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:15.540669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:15.547054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:15.547492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:15.548245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:15.548674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:15.681986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:15.690079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ffa01845-b06d-476f-835a-23cb073d4d12 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153975 Aug 02 09:39:15.690639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1516/2579] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:15.995827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:15.999515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:16.003947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.004399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.005207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.005644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.144478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:16.153201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d4b3eb1a-1dda-411c-84fa-c0714c84a1fd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161157 Aug 02 09:39:16.154012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1517/2580] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:16.159833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:16.160436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:16.166537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.167241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.168717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.169186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.233735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:16.242367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:16.244079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:16.245266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0c25748e-c08b-4f1c-8ade-b50bebddcb7b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089694 Aug 02 09:39:16.247254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1518/2581] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:16.257702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:16.258340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:16.264839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.265317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.266095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.266535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.286172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:16.331226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:16.338811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34b7e470-794e-4214-8321-80090e115421 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084698 Aug 02 09:39:16.339433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1519/2582] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:16.711845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:16.712502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:16.719650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.720096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.720849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:16.721321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:16.851991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:16.860728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-48443587-4573-4e4c-a764-a30f0d580302 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152795 Aug 02 09:39:16.861435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1520/2583] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:17.174375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:17.174915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:17.177881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:17.182133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.182586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.183506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.183941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.314606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:17.322509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d89fa387-e40e-4c14-8adc-9edb4273907a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152100 Aug 02 09:39:17.323087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1521/2584] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:17.328065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:17.328674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:17.334438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.334885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.335641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.336100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.400732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:17.409178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:17.410685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:17.411819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-63a2d92e-a351-42e0-b972-35ff3b34d18e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087827 Aug 02 09:39:17.412381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1522/2585] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:17.416682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:17.417312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:17.422931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.423381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.424136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.424629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.485372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:17.492855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-01c12504-d83c-46d3-8f36-e1b94e3c5af3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079532 Aug 02 09:39:17.493479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1523/2586] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:17.882142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:17.882830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:17.889559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.890008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:17.890778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:17.891218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.024080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:18.032885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fcaa03a3-71c5-48c1-804b-8fa16ec293eb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154613 Aug 02 09:39:18.033494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1524/2587] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:18.344634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:18.345290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:18.351264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:18.351713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.352466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:18.352903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.483008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:18.491147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b290f3a-2e57-43f4-a7db-a89cec725f3d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150374 Aug 02 09:39:18.491731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1525/2588] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:18.497393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:18.498010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:18.503829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:18.504288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.505057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:18.505524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.565915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:18.574449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:18.575970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:18.577131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a2251b04-bb20-4dc2-963e-f72f2c10e9a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084467 Aug 02 09:39:18.577711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1526/2589] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:18.582159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:18.582773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:18.588393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:18.588842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.590008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:18.590456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:18.650564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:18.658053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3bbe120-b7be-473e-8d66-fa3af4dc90a2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079393 Aug 02 09:39:18.658646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1527/2590] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:19.054262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:19.054979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:19.062008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.062456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.063224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.063663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.194527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:19.203099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ebbd1dd5-8259-483b-b8da-7e6111377869 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152773 Aug 02 09:39:19.203660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1528/2591] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:19.513799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:19.514419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:19.520414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.520870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.521652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.522094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.649664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:19.658563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0cbc5611-9005-424f-b4cf-779c2391668e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149439 Aug 02 09:39:19.659129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1529/2592] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:19.663520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:19.664115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:19.670543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.670984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.671731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.672157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.734269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:19.743506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:19.745149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:19.746945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-020de34c-6ebd-4041-8c48-68bfef7c4e45 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086891 Aug 02 09:39:19.747507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1530/2593] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:19.751905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:19.752512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:19.758238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.758686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.759739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:19.760129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:19.829616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:19.837131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c2ad1314-b067-437c-9304-07f3a47f8f36 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088660 Aug 02 09:39:19.837705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1531/2594] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:20.225363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:20.225985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:20.232459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.232909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.233711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.234154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.365895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:20.374598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-84d5dd69-8e4d-4cb2-9420-89ff16271e36 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153246 Aug 02 09:39:20.375166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1532/2595] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:20.679058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:20.679671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:20.686561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.687000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.687751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.688181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.816047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:20.824523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b1312ea9-7fc9-4166-97e0-bd93300a3cda tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148745 Aug 02 09:39:20.825102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1533/2596] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:20.829631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:20.830240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:20.835884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.836338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.837102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.837563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.904457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:20.912965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:20.914503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:20.915644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a7a1248-206e-42f9-a79f-37f6cdc5a36b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089607 Aug 02 09:39:20.916207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1534/2597] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:20.920800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:20.921427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:20.927250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.927724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.928468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:20.928901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:20.989371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:20.997023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb53003c-c5f0-4389-a5fb-b50742e1ef95 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079875 Aug 02 09:39:20.997631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1535/2598] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:21.400042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:21.400736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:21.407719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:21.408170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:21.408934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:21.409391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:21.413247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:21.539600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:21.547996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-00f2b1b9-e06d-4992-842f-68d13b788954 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151866 Aug 02 09:39:21.548570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1536/2599] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:21.846925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:21.847540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:21.853572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:21.854020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:21.854774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:21.856409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:21.990449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:21.999592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-489991b2-5010-40e9-b7b6-d99ef0e30e2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156658 Aug 02 09:39:22.000173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1537/2600] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:22.004566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:22.005197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:22.011135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:22.012661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:22.013776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:22.014224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:22.078277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:22.086710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:22.088223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:22.089920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c194cb07-9a26-4c3b-9dee-859b0676cdfd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088268 Aug 02 09:39:22.090494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1538/2601] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:22.094855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:22.095464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:22.101017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:22.101509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:22.102269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:22.102704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:22.164411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:22.172507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3675b9f7-586a-46d7-90b9-de622a7783b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081064 Aug 02 09:39:22.173081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1539/2602] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:22.569752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:22.570502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:22.576834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:22.577318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:22.578085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:22.578524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:22.708543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:22.717016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2239feae-65b2-44cd-a74a-a114bac03aa0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151124 Aug 02 09:39:22.717618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1540/2603] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:23.022280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:23.022883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:23.029656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.030112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.030885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.031323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.159815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:23.167908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd6a19c1-0d83-4b84-a672-8201f86e0bd0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149569 Aug 02 09:39:23.168483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1541/2604] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:23.173074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:23.173655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:23.179376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.179817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.180601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.181034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.242202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:23.250581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:23.252093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:23.253294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-73ebda74-e896-4886-876b-a25158eb580d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083835 Aug 02 09:39:23.253854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1542/2605] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:23.258149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:23.258751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:23.265240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.265695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.266449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.266881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.327493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:23.335084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4f0bd68-2be6-4a0f-af5d-ab39757ff805 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080265 Aug 02 09:39:23.335652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1543/2606] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:23.738690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:23.739331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:23.746552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.747006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:23.747771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:23.748209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.054113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:24.062960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8886a689-424d-4d4d-a5cf-517f8356553a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.327706 Aug 02 09:39:24.063114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1544/2607] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:24.189500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:24.190102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:24.195942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:24.196382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.197149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:24.197583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.325394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:24.333176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8d5b3478-e5b5-4739-a08a-5ceb01c9a9fc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147355 Aug 02 09:39:24.333732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1545/2608] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:24.338140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:24.338741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:24.345208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:24.345657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.346406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:24.346835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.411797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:24.420827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:24.422400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:24.423548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5b21507-d200-469f-bfcc-0c86fa3164a8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088900 Aug 02 09:39:24.424105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1546/2609] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:24.428416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:24.429022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:24.434634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:24.435084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.435844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:24.436281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:24.496500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:24.503885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8030f7f-3986-4fc4-89eb-9518dd97034d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.078837 Aug 02 09:39:24.504449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1547/2610] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:25.084185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:25.084829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:25.092073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.092520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.093354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.093824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.221493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:25.229480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c7a75484-1374-4af2-9c7a-b48e0b27ce2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149106 Aug 02 09:39:25.230604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1548/2611] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:25.354811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:25.355499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:25.361421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.361874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.362640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.363079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.494081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:25.502681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eb0b38c2-9232-4c6d-97df-3a2eb2bed90d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151580 Aug 02 09:39:25.503254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1549/2612] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:25.507680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:25.508284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:25.514954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.515403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.516158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.516592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.579984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:25.588259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:25.590831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:25.591982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19f0ec7c-6254-415e-9f50-1276cf5ea01b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087804 Aug 02 09:39:25.592541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1550/2613] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:25.596849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:25.597486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:25.603051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.603498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.604251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:25.604680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:25.665324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:25.673514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1acd6c41-c09a-4730-acaa-241b342cbe14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080000 Aug 02 09:39:25.674077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1551/2614] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:26.252253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:26.252893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:26.259418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.259875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.260629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.261368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.392345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:26.395880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:26.401193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aad078aa-f79f-4593-9ca1-5d8c380a4803 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152962 Aug 02 09:39:26.401758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1552/2615] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:26.523930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:26.524465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:26.531768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.532212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.532970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.533432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.662026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:26.669932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-92c4c822-c133-4c0f-88fb-4429effb8b06 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149955 Aug 02 09:39:26.670486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1553/2616] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:26.675079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:26.675686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:26.683862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.685010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.685785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.686221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.747633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:26.756060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:26.757579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:26.758848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dda397b2-3f38-4997-8180-ab067bfdd257 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087316 Aug 02 09:39:26.759671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1554/2617] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:26.764656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:26.765293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:26.771050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.771497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.772254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:26.772690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:26.833565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:26.841966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56abc10c-98e0-4a9a-9f0b-5c936c7bc761 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081341 Aug 02 09:39:26.842530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1555/2618] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:27.423370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:27.423993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:27.430541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.431006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.431817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.432254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.564523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:27.572535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b57aa9c4-4987-4817-9536-55b31594e009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153207 Aug 02 09:39:27.573103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1556/2619] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:27.691799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:27.692324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:27.698409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.698858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.699609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.700040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.827595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:27.835613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fee36b9c-2dac-4980-8a13-810257f112ca tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147691 Aug 02 09:39:27.836186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1557/2620] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:27.840558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:27.841188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:27.847040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.847491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.856388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.857926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.924702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:27.934208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:27.936371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:27.937555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72d9de1b-32a2-42f8-a97a-0fd002c115ff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.100423 Aug 02 09:39:27.938108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1558/2621] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:27.942617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:27.943231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:27.950244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.950244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:27.950856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:27.951287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:28.014193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:28.021831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-57d59210-0022-48c1-838c-1e5b93b0537a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082764 Aug 02 09:39:28.022396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1559/2622] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:28.595181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:28.595853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:28.602357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:28.602809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:28.603574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:28.604015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:28.731763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:28.740240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a4c499b-881b-4c8c-931d-cbef9431e769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149794 Aug 02 09:39:28.740804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1560/2623] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:28.855779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:28.856300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:28.862796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:28.863250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:28.864024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:28.864462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:28.997184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:29.005785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9835bd52-7668-490b-b5ee-c3ebe461ffe9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153947 Aug 02 09:39:29.006350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1561/2624] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:29.012109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:29.012719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:29.019359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:29.019782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:29.021272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:29.021733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:29.082938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:29.091261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:29.092866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:29.094032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f422e80b-2834-408a-9e59-611e8a77c814 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086757 Aug 02 09:39:29.094586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1562/2625] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:29.099042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:29.099645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:29.105250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:29.105699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:29.106529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:29.106905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:29.168015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:29.175994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bdd37b8b-0add-4b8a-8c58-44e1800d0f8c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080462 Aug 02 09:39:29.176629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1563/2626] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:29.762139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:29.762819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:29.769292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:29.769953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:29.770813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:29.771256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:29.797705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:39:29.802115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 (ip 10.222.0.100) !!! Aug 02 09:39:29.910931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:29.924132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1a11b00b-b63d-47c4-9817-dedcc717f3bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.166032 Aug 02 09:39:29.924710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1564/2627] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:30.028805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:30.029372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:30.035892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.036334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.037088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.037541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.167723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:30.175838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e228a1e3-5e2b-48de-9b13-b479a57da6c6 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151022 Aug 02 09:39:30.176407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1565/2628] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:30.180928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:30.181566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:30.187151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.187603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.188364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.188807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.249742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:30.258148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:30.259917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:30.261066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-205bc745-c83a-499e-a287-ea0eb2a71ec1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083731 Aug 02 09:39:30.261657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1566/2629] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:30.266991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:30.267600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:30.273513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.274071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.274930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.275370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.335152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:30.343123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9a6bc5bb-f91a-4eb3-aa3a-721eb5e83601 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080528 Aug 02 09:39:30.343685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1567/2630] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:30.945788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:30.946412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:30.953080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.953558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:30.954316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:30.954752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.086471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:31.095100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d051ca28-eb9b-4a74-9c82-dcd34065dafd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153180 Aug 02 09:39:31.095678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1568/2631] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:31.197558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:31.198103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:31.204903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:31.205587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.206402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:31.206882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.225930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:31.339364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:31.349583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b04aa3f-cc4f-41a7-ad91-ba4a3679c282 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155306 Aug 02 09:39:31.350110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1569/2632] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:31.354884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:31.355498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:31.362446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:31.362904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.363680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:31.364119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.428902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:31.437598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:31.439114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:31.440262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c295f875-259f-43c8-84e3-eaf2cccde489 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089138 Aug 02 09:39:31.440826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1570/2633] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:31.445355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:31.445971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:31.448663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:31.452493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:31.452943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.453736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:31.454355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:31.516103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:31.523792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-35d8910d-14b6-4170-9821-44b0c3410fea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081887 Aug 02 09:39:31.524370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1571/2634] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:31.864150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:39:31.864374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:39:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:39:32.117605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:32.118240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:32.125213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.125670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.126736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.127459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.258163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:32.267271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-48a8ad61-b626-4f98-9b0e-770912fa1625 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153688 Aug 02 09:39:32.267848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1572/2635] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:32.371039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:32.371587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:32.378365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.378815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.379583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.380025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.512654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:32.520699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8abfa3c7-d2a6-4ce8-ad19-ff21e0a59746 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153512 Aug 02 09:39:32.521305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1573/2636] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:32.525745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:32.526366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:32.531924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.532374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.533157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.533602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.593759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:32.602131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:32.603672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:32.604812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-180fd9c2-c518-477e-910c-f6187143694e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.082557 Aug 02 09:39:32.605416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1574/2637] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:32.610486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:32.611095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:32.616665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.617142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.617907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:32.618374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:32.679925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:32.687491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0539af5-ae4d-4650-9870-a7921cfc005c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081134 Aug 02 09:39:32.688052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1575/2638] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:33.287867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:33.288549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:33.295093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.295547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.296396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.296830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.428654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:33.437205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-559ee490-b7c8-4d2f-86c1-9bbed88f2c33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153192 Aug 02 09:39:33.437722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1576/2639] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:33.542185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:33.542716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:33.549020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.549511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.550280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.550722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.677211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:33.685041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-46fa25ce-f6be-424a-84d1-2e8c188bd07e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146904 Aug 02 09:39:33.686268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1577/2640] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:33.690748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:33.691344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:33.697154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.697499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.698252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.698711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.760407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:33.769479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:33.771017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:33.772163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c337742-6a8a-416f-932b-21a7295cc68f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084898 Aug 02 09:39:33.772732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1578/2641] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:33.777704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:33.778315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:33.784038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.784490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.785285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:33.785729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:33.847532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:33.854980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1bb398ff-809b-41b5-8044-238b847af715 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080692 Aug 02 09:39:33.855547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1579/2642] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:34.458026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:34.458678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:34.465290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.465744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.466510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.467167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.597529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:34.605425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7498da55-73bf-4bf5-8bd4-eda899a00e4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151244 Aug 02 09:39:34.605995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1580/2643] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:34.707611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:34.708265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:34.714259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.714695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.715444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.715904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.846054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:34.853982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c29d7f1a-2680-4dcd-8d54-85233233b806 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150174 Aug 02 09:39:34.854548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1581/2644] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:34.859059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:34.859655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:34.865257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.865694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.866445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.866915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.932253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:34.941190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:34.942709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:34.943833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0d5108f2-f54e-4c6b-a297-292c8942380c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088385 Aug 02 09:39:34.944387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1582/2645] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:34.948904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:34.949523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:34.955961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.956416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:34.957172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:34.957665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:35.018592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:35.026203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-09b059a1-2ab8-4ddb-a4a8-9b4401320641 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080886 Aug 02 09:39:35.026771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1583/2646] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:35.627056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:35.627695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:35.634460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:35.634912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:35.635675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:35.636113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:35.762888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:35.771197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba139469-c5d4-4db5-b41e-dbe73efedaba tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148596 Aug 02 09:39:35.771772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1584/2647] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:35.875006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:35.875620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:35.881620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:35.882013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:35.882778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:35.883220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.021599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:36.030102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2adfc94a-8c76-4674-9967-08193b21e44a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158318 Aug 02 09:39:36.030682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1585/2648] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:36.035217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:36.035825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:36.041697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:36.042145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.042913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:36.043352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.047414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:36.105356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:36.113931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:36.115439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:36.116579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-af62a325-29c7-48d2-87ae-211fb7b1f6d9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084976 Aug 02 09:39:36.117215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1586/2649] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:36.121575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:36.122187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:36.128221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:36.128674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.129483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:36.129929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.191132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:36.198505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-67d484da-298c-4e13-8b94-f452611459df tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080345 Aug 02 09:39:36.199076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1587/2650] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:36.793242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:36.793914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:36.801183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:36.801626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.802372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:36.802800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:36.933752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:36.942429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b151b8d2-4227-4e8e-9b55-6ebf929c6f77 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153048 Aug 02 09:39:36.943036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1588/2651] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:37.052019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:37.052639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:37.058702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.059154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.059922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.060944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.188674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:37.196578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8a99cc62-6965-47f1-90b1-84ae079c3b53 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148497 Aug 02 09:39:37.197161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1589/2652] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:37.201514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:37.202210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:37.207712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.208178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.208929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.209387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.271103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:37.280139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:37.281683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:37.282816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d402a65f-01a5-4dc5-b471-3fac43ce125d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084746 Aug 02 09:39:37.283374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1590/2653] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:37.287654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:37.288251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:37.294035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.294480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.295840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.296268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.355360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:37.363372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f912dd57-f72b-471e-b0f8-5f63022100c6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079056 Aug 02 09:39:37.363941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1591/2654] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:37.969359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:37.970011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:37.976509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.976954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:37.977752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:37.978185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.109631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:38.117484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-63beedae-856d-47e1-bb11-f55979374bff tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152159 Aug 02 09:39:38.118282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1592/2655] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:38.217664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:38.218200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:38.224034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:38.224469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.225242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:38.225672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.351901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:38.360405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6496d074-fc5e-4ecc-8d45-774749042fcc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146635 Aug 02 09:39:38.360981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1593/2656] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:38.365481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:38.366087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:38.371757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:38.372208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.373973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:38.374471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.438224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:38.446578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:38.448065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:38.449228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e780f72-3646-4b92-b5a6-bf34251758f0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087276 Aug 02 09:39:38.449781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1594/2657] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:38.454189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:38.454782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:38.460483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:38.460924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.461786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:38.462217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:38.524209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:38.531997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-97e16d77-d6d4-495a-927c-751bdc99c816 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081288 Aug 02 09:39:38.532556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1595/2658] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:39.139445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:39.140088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:39.146585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.147028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.147775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.148202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.275466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:39.283442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-922c5bcb-a15a-455e-8df2-f642aa51c0bc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147928 Aug 02 09:39:39.284006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1596/2659] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:39.381841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:39.382459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:39.388862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.389381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.390149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.391040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.520857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:39.528843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0ac197c6-77db-4734-8e8f-1b337f523725 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150792 Aug 02 09:39:39.530190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1597/2660] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:39.534643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:39.535247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:39.540958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.541446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.542205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.542644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.603521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:39.612587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:39.614204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:39.615383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-770d6d52-f38f-4605-a017-d0c36ac3927d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084239 Aug 02 09:39:39.615943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1598/2661] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:39.620377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:39.620986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:39.626748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.627196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.627950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:39.628381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:39.646165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:39:39.646700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:39:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:39:39.691741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:39.699239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bd13ea90-668b-4536-ab18-15489fae0a66 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082351 Aug 02 09:39:39.699817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1599/2662] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:40.305673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:40.306319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:40.313926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.314380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.315145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.315582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.444803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:40.453423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-187edc5c-4e57-4009-9b75-68f89e742cc1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151681 Aug 02 09:39:40.454002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1600/2663] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:40.553626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:40.554234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:40.561003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.561479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.562235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.562669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.691149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:40.699156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e5987980-b892-474e-960f-224440b27e2f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149336 Aug 02 09:39:40.699723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1601/2664] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:40.704180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:40.704784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:40.710582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.711036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.711797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.712238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.774869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:40.778281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:40.784506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:40.786034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:40.787192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3144e3e-f2c0-4874-86ee-791e4684f1cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086540 Aug 02 09:39:40.787755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1602/2665] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:40.792283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:40.792888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:40.799507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.799962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.800734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:40.801199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:40.861542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:40.868914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1076ba3b-134d-4319-b69f-35bd10b67d14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080216 Aug 02 09:39:40.869520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1603/2666] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:41.474899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:41.475561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:41.482264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.482934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.483638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.484076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.612376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:41.620391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c031d7d4-8e3a-4aad-85eb-95d4cb7a02e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149448 Aug 02 09:39:41.620949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1604/2667] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:41.719381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:41.719983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:41.725855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.726296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.727045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.727470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.853953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:41.862096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-822d516b-83fd-4070-8bdb-3f188308d139 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146383 Aug 02 09:39:41.862671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1605/2668] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:41.867063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:41.867665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:41.873853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.874304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.875061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.875493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.939907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:41.948286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:41.949827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:41.951741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e279b6f4-722f-440c-b7cf-1fe4914bcdbe tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087383 Aug 02 09:39:41.952311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1606/2669] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:41.956626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:41.957248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:41.962880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.963325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:41.964081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:41.964517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:42.026543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:42.034219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5f787b2c-e2e2-4042-bef2-3fe3af9b9279 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080967 Aug 02 09:39:42.034818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1607/2670] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:42.642549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:42.643174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:42.649744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:42.650193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:42.650950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:42.651382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:42.776977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:42.785677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-93e7701b-c8ae-458b-ac51-22e9b16844fa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147163 Aug 02 09:39:42.786247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1608/2671] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:42.883426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:42.884037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:42.890918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:42.891310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:42.892075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:42.892539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.027676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:43.036520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-708cef06-5157-4746-a8e0-85aaf1d6ee2a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156917 Aug 02 09:39:43.037093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1609/2672] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:43.041645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:43.042256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:43.048010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:43.048462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.049311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:43.049843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.110471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:43.118852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:43.120355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:43.121522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c9404fb4-96b3-4ecc-bbcc-0414f93db894 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083462 Aug 02 09:39:43.122093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1610/2673] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:43.127382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:43.127996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:43.133883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:43.134591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.135357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:43.135798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.196039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:43.204170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0ce666d4-ea0c-4474-8343-1abebdf9db86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080578 Aug 02 09:39:43.204740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1611/2674] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:43.811033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:43.811662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:43.818246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:43.818697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.819461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:43.819897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:43.949608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:43.958234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32d20202-2934-4e36-99dc-beb654857f2e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151699 Aug 02 09:39:43.958806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1612/2675] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:44.057671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:44.058293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:44.065029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.065451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.066219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.066660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.193445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:44.201887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e068964-4498-4a23-a7f0-0f7e375864dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148084 Aug 02 09:39:44.202460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1613/2676] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:44.206903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:44.207512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:44.213137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.213606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.214397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.214836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.277137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:44.286283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:44.287799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:44.288945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34276b38-2745-490c-9bae-c6669015655c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085560 Aug 02 09:39:44.289566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1614/2677] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:44.293912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:44.294685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:44.300281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.300731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.301526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.301968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.361330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:44.368639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa5e53e2-b058-49c5-aa6a-5f2f8e88b31a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.078124 Aug 02 09:39:44.369226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1615/2678] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:44.979696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:44.980322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:44.987228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.987677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:44.988443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:44.988883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.120116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:45.128873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c6047020-c61c-4eb8-885d-e1798096afa9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153223 Aug 02 09:39:45.129490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1616/2679] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:45.223301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:45.223839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:45.229723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:45.230175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.230937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:45.231369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.358528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:45.366642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9137d7a5-d1cd-4113-b162-d9c8a4e8c92c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147245 Aug 02 09:39:45.367210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1617/2680] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:45.371602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:45.372206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:45.378518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:45.378965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.379724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:45.380158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.443613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:45.451963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:45.453494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:45.454637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-14f0fc45-57a0-438f-9434-f8e12668494b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086505 Aug 02 09:39:45.455197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1618/2681] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:45.459799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:45.460410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:45.466076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:45.467016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.467920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:45.468358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:45.486962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:45.532201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:45.539873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-07e530e7-598a-4eb2-8a04-817632bf4781 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083735 Aug 02 09:39:45.540447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1619/2682] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:46.151547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:46.152225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:46.158661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.159154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.159918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.160355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.289641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:46.297584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4daa0e38-f328-4318-9838-778c8a6b5f31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150148 Aug 02 09:39:46.298152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1620/2683] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:46.388983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:46.389625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:46.392459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:46.396344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.396794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.397609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.398049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.527889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:46.536011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-377be99c-a8b9-4a50-93c5-16646c320d92 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151682 Aug 02 09:39:46.536570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1621/2684] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:46.541073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:46.541733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:46.547929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.548379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.549148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.549580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.610208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:46.618492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:46.620001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:46.621171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f426d895-bb5b-4536-bc52-e0680600eb4c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.083661 Aug 02 09:39:46.621735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1622/2685] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:46.626813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:46.627419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:46.633287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.633743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.634767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:46.635234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:46.698503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:46.706208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-142f5789-4fdc-4fc1-bbdb-fb67b8861f16 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083526 Aug 02 09:39:46.706779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1623/2686] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:47.319928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:47.320598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:47.328011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.328458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.329268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.329709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.458812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:47.467383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6ca28ca0-45d4-4e86-ac6f-67160cb08233 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151342 Aug 02 09:39:47.467953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1624/2687] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:47.557275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:47.557891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:47.564461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.564913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.565715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.566158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.692687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:47.700820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-37f3fe67-e11b-4b96-9f41-69f98c76037f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147096 Aug 02 09:39:47.701643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1625/2688] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:47.706049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:47.706655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:47.712449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.712896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.713687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.714145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.774926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:47.784103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:47.785623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:47.786763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-734d92d0-c732-4b4c-aed5-a036293f2d61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084194 Aug 02 09:39:47.787323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1626/2689] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:47.791623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:47.792221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:47.798509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.798955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.799736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:47.800168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:47.859788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:47.867108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d83d0f0c-2476-47c4-ae3a-67e504333e43 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.078846 Aug 02 09:39:47.867681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1627/2690] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:48.488127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:48.488803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:48.495378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.495830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.496593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.497037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.627510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:48.635897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-872404c5-3114-4a1b-99ca-bd6e0e72cc2d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151710 Aug 02 09:39:48.636467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1628/2691] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:48.722316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:48.722928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:48.728735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.729213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.729969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.730396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.857592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:48.865582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d2bd9ba3-cc58-4bc1-9565-0272f0dc2114 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147016 Aug 02 09:39:48.866164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1629/2692] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:48.870572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:48.871217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:48.877546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.877998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.878829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.879268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.943622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:48.952093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:48.953659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:48.954800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-09b9be58-e110-496b-a22a-dbcb8fec9bdf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087715 Aug 02 09:39:48.955363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1630/2693] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:48.959765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:48.960371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:48.965935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.966384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:48.967142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:48.967575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:49.027408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:49.035050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-43b15187-cd38-49dc-8a18-e673c16780d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.078731 Aug 02 09:39:49.035923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1631/2694] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:49.658530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:49.659239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:49.665788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:49.666471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:49.667419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:49.667943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:49.799503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:49.807853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6116a56b-e880-4fd2-92f9-f469e060ab07 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153107 Aug 02 09:39:49.808433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1632/2695] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:49.887832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:49.889017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:49.894936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:49.895388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:49.896150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:49.896591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.032916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:50.040783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b13c17e1-4db9-4213-ae54-006410312947 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157009 Aug 02 09:39:50.041389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1633/2696] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:50.045979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:50.046586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:50.053863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:50.054314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.055080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:50.055517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.117375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:50.126229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:50.127724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:50.128857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-149abf20-a0ab-4590-992d-5a2ec920c17b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086547 Aug 02 09:39:50.129458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1634/2697] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:50.133834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:50.134682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:50.140907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:50.141387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.142149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:50.142581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.202187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:50.209792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5642461-22c6-4f29-927b-31edfc69ff7f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079399 Aug 02 09:39:50.210363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1635/2698] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:50.829963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:50.830627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:50.836589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:50.837042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.837839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:50.838279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:50.842733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:50.972359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:50.980385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-88cc94a7-d0a2-4e6b-875f-22196afa1142 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155181 Aug 02 09:39:50.980959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1636/2699] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:51.062061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:51.062677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:51.068635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:51.069088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:51.069889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:51.070329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:51.198259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:51.209824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6b79e1a3-a9b6-4951-87b7-eeb6e4aad5c5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151547 Aug 02 09:39:51.210473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1637/2700] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:51.214963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:51.215568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:51.222280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:51.222733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:51.223502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:51.223944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:51.286151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:51.294550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:51.296067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:51.297240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e47ea1f8-bb14-42cb-a0e2-fd242dc94223 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085809 Aug 02 09:39:51.297804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1638/2701] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:51.302130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:51.302743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:51.308311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:51.308764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:51.309562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:51.310004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:51.369847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:51.377901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ce1b078b-20c5-4852-a7f4-206f62b6e76a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079152 Aug 02 09:39:51.378472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1639/2702] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:52.003568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:52.004170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:52.011065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.011518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.012281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.012717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.146105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:52.154399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f46c6f99-6475-4893-8540-36e23958d80f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154740 Aug 02 09:39:52.155144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1640/2703] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:52.232355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:52.232969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:52.238989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.239432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.240183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.240606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.368995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:52.376926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-360682c3-07b2-43e6-ae76-9e347e0b3eee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148962 Aug 02 09:39:52.377530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1641/2704] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:52.381866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:52.382474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:52.388541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.388983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.389821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.390251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.453530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:52.461683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:52.463169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:52.464296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ecb22729-b3f5-4616-8f5b-33cf8ff2c1c3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085856 Aug 02 09:39:52.464858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1642/2705] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:52.469877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:52.470479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:52.476595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.477228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.478002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:52.478424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:52.538900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:52.546790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5de10f57-4bb5-483b-950e-6448d865d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080969 Aug 02 09:39:52.547350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1643/2706] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:53.176282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:53.176954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:53.183478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.183922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.184683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.185264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.312402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:53.320356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8ded7e9e-0db1-4d9e-baca-53eebc70e5b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147997 Aug 02 09:39:53.320933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1644/2707] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:53.398503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:53.399119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:53.405788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.406269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.407036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.407477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.755960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:53.764217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa23e975-896a-4fb9-b168-4e0a7b414410 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.369514 Aug 02 09:39:53.764790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1645/2708] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:53.769259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:53.769875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:53.775431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.775883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.776643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.777081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.836803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:53.845776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:53.847396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:53.848674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e07de063-0eba-40c6-acea-8d29326ce943 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.082924 Aug 02 09:39:53.849277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1646/2709] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:53.853630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:53.854241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:53.860485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.860938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.861744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:53.862193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:53.923914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:53.931570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ef265cb-8580-43c5-81a7-d23cd919f82c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081342 Aug 02 09:39:53.932134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1647/2710] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:54.342994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:54.343666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:54.350240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:54.350724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:54.351489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:54.351929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:54.481331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:54.489546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-691f662e-fc33-4fb1-8608-6c95b5239742 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151049 Aug 02 09:39:54.490121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1648/2711] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:54.785448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:54.786072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:54.792335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:54.792773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:54.793570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:54.794543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:54.921669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:54.929681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f4ccd8d3-7194-45a2-883c-25c4d09ae822 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148139 Aug 02 09:39:54.930252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1649/2712] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:54.935315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:54.935995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:54.941749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:54.942202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:54.942966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:54.943403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:55.005995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:55.015339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:55.016843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:55.020008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a3c3ee83-6b11-4e0d-b0b5-e655136baffc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088775 Aug 02 09:39:55.020593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1650/2713] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:55.025057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:55.025714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:55.031837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:55.032371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:55.033203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:55.033648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:55.093821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:55.101383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6a6da528-d909-4b5f-97dc-de6230fa4372 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079675 Aug 02 09:39:55.101951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1651/2714] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:55.512111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:55.513396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:55.519791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:55.520242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:55.521007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:55.521475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:55.650771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:55.654846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:39:55.659857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b9af349-3a0a-4046-9ff2-af4ad6afc5b9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151919 Aug 02 09:39:55.660445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1652/2715] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:55.951926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:55.952526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:55.958551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:55.958996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:55.959747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:55.960178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.086286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:56.094188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9e614e14-e590-45d9-8614-d37cbb836041 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147120 Aug 02 09:39:56.094749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1653/2716] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:56.099109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:56.099713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:56.105361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:56.105808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.106561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:56.106997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.172008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:56.180408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:56.181956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:56.183105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bef61231-749c-424a-98c3-9657652cb99a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087440 Aug 02 09:39:56.183668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1654/2717] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:56.189119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:56.189744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:56.195493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:56.195945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.196700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:56.197156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.259450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:56.267995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ae2c9c2a-4e60-4481-9655-50cbab049850 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083334 Aug 02 09:39:56.268570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1655/2718] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:56.680676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:56.681354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:56.687805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:56.688252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.689016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:56.689471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:56.816902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:56.824837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a709fee7-55b4-4b20-bbd6-1c99226fb4a9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148078 Aug 02 09:39:56.825564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1656/2719] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:57.115490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:57.116030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:57.122113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.122620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.123418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.123860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.256338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:57.265154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02aa8ce6-2261-477d-afed-0f8f4ffa4a77 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153598 Aug 02 09:39:57.265732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1657/2720] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:57.270175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:57.270783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:57.276402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.276850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.277651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.278119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.339851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:57.348925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:57.350475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:57.351628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6c9d3911-404a-497a-8bb9-9de4d6067a62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084970 Aug 02 09:39:57.352197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1658/2721] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:57.356765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:57.357409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:57.363006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.363454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.364215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.364650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.425241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:57.432778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-feb84ecf-c050-4bc3-a145-2fcc69c52ded tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079613 Aug 02 09:39:57.433428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1659/2722] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:57.846467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:57.847133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:57.853405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.853859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.854622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:57.855059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:57.993207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:58.001754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b809105-24ec-444c-8eca-13f524648763 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159184 Aug 02 09:39:58.002323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1660/2723] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:58.286519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:58.287127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:58.293562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:58.294597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:58.295349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:58.295778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:58.423127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:58.431055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6f2466da-2b9f-44b1-849b-44a257315dbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148424 Aug 02 09:39:58.431630 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1661/2724] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:58.436130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:58.436736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:58.442291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:58.442749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:58.443511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:58.443948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:58.504942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:58.514196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:58.515712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:58.516856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d1c2f04-3900-4d13-bbe9-d60eb0f2b104 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084305 Aug 02 09:39:58.517450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1662/2725] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:58.521826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:58.522440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:58.528292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:58.528987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:58.529540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:58.529999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:58.589658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:58.597385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-12c36468-5648-4514-861b-629dcdf07fca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.078951 Aug 02 09:39:58.597953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1663/2726] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:39:59.023324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:59.023968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:59.030741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.031185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.031939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.032375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.164362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:59.172935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f8348a35-2dd3-4b04-a4a1-40a3f97adaca tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153509 Aug 02 09:39:59.173485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1664/2727] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:59.453445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:59.454001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:59.460480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.460930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.461735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.462182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.593694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:59.601746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9be3ad37-0540-4781-b7da-e40da0c3ac1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152905 Aug 02 09:39:59.602329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1665/2728] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:39:59.606826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:59.607435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:59.613055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.613537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.614422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.614854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.680044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:59.689445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:59.690964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:59.692116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41f629d9-c82f-426e-83e3-dfbd53a4af36 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088861 Aug 02 09:39:59.692679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1666/2729] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:39:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:39:59.697167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:39:59.697776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:39:59.704324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.704719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.705682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:39:59.706128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:39:59.767639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:39:59.775236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bbcb718c-2760-4dbd-a8a4-4eceedb5df11 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081576 Aug 02 09:39:59.775814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1667/2730] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:39:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:00.193307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:00.193973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:00.200023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.200478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.201292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.201733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.300878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:40:00.301491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:40:00.331949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:00.339953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95298889-aa60-40c6-a7ad-9037b889b1e3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150560 Aug 02 09:40:00.340549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1668/2731] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:00.623215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:00.623823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:00.630206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.630660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.631409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.631838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.651340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:00.764266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:00.772209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-543361d7-0dfc-4dbe-8e1f-51bd821104de tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153400 Aug 02 09:40:00.772781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1669/2732] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:00.777200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:00.777831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:00.783411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.783857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.784674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.785183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.846127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:00.854530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:00.856039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:00.857912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7db8b802-4335-4ae6-a153-0fd9c364e3fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084167 Aug 02 09:40:00.858478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1670/2733] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:00.862808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:00.863420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:00.866067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:00.869730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.870184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.870946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:00.871387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:00.932901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:00.941407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-812582f4-db80-45c8-aa56-c70e7bb0eed7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081950 Aug 02 09:40:00.941984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1671/2734] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:01.362141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:01.362789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:01.368761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:01.369235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:01.369992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:01.370422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:01.501238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:01.509327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3edff580-5f1a-4165-a91b-d24d232ec613 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150821 Aug 02 09:40:01.509900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1672/2735] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:01.793392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:01.794544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:01.800988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:01.801464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:01.802222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:01.802647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:01.936321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:01.944390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f7caddc-9c5b-41c7-aa1e-2b87be02c094 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154912 Aug 02 09:40:01.944993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1673/2736] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:01.949404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:01.950624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:01.956223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:01.956684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:01.957474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:01.957916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:02.020282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:02.029324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:02.030853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:02.032002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32589820-e169-4632-8165-cb0919388644 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086058 Aug 02 09:40:02.032575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1674/2737] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:02.037053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:02.037695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:02.043811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:02.044260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:02.044949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:02.045417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:02.107321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:02.114738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-26047e56-3d1d-4df1-aa8d-f6ae5a38fdda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081210 Aug 02 09:40:02.115309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1675/2738] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:02.531732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:02.532382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:02.538492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:02.538950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:02.539711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:02.540148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:02.670726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:02.679176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0e12808-19e6-4b29-b050-969da467e250 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151940 Aug 02 09:40:02.679855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1676/2739] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:02.966676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:02.967295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:02.974114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:02.974699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:02.975352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:02.975789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.104471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:03.112564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9e84f84-dba3-40e9-b15d-1bf44c8e4230 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150451 Aug 02 09:40:03.113151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1677/2740] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:03.117555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:03.118165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:03.124040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:03.124491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.125281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:03.125723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.190424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:03.198864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:03.201357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:03.202504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-64d1d3e4-5aa7-4bfb-a7dd-7e105dd218ab tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088419 Aug 02 09:40:03.203071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1678/2741] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:03.207491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:03.208099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:03.213708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:03.214160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.214916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:03.215355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.276760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:03.285396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bb8f0b2c-553e-46b8-b099-762fb416a4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081351 Aug 02 09:40:03.285966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1679/2742] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:03.701374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:03.702090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:03.708029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:03.708482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.709288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:03.709728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:03.838414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:03.846477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-380ff874-06f2-46e7-b144-96fe8cafb005 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149824 Aug 02 09:40:03.847053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1680/2743] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:04.133512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:04.134516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:04.142015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.142469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.143245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.143686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.278738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:04.286768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-517dd4a0-ce87-4d18-b148-5be5335a6ac2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157397 Aug 02 09:40:04.287337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1681/2744] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:04.291922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:04.292526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:04.299315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.299770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.300539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.301076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.362459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:04.370834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:04.372403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:04.373578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-171cc485-e9f2-4746-8940-fed36a1ea5e0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085311 Aug 02 09:40:04.374150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1682/2745] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:04.378566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:04.379176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:04.385439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.385829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.387020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.387530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.449004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:04.456956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a85cfe79-f21f-4081-aa3d-a3d344faeff7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081855 Aug 02 09:40:04.457562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1683/2746] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:04.868493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:04.869105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:04.875672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.876118 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:04.876873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:04.877343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.009739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:05.018888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8d2241b-3d97-4c31-b2d0-3c12d08f599e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154262 Aug 02 09:40:05.019462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1684/2747] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:05.310241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:05.310858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:05.317368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:05.317818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.318582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:05.319016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.450786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:05.458751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c88748a4-fdf7-4dc7-a45e-a1e8fb1ecf8b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153073 Aug 02 09:40:05.459317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1685/2748] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:05.463879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:05.464477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:05.470388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:05.470830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.471586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:05.472016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.476138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:05.534273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:05.542620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:05.544896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:05.546077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1da900df-b38b-4bc2-b6f3-2abb84f2c1b5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085804 Aug 02 09:40:05.546651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1686/2749] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:05.551028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:05.551640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:05.557681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:05.558163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.558953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:05.560056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:05.619881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:05.628090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6d538515-1b42-4943-b8c9-5fb9d344bc94 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080497 Aug 02 09:40:05.628697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1687/2750] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:06.040170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:06.040790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:06.046912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.047355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.048111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.048544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.177717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:06.185770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e6f57e4-444e-4e3f-9484-97ddbc1da37f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149372 Aug 02 09:40:06.186351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1688/2751] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:06.479872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:06.480407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:06.487050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.487514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.488306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.488743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.616524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:06.625146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11d18318-f3c4-4469-8cfb-879b869e9e13 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149237 Aug 02 09:40:06.625717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1689/2752] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:06.630122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:06.630725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:06.636559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.637008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.638366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.638810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.705620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:06.713968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:06.715972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:06.717133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-62012824-1e0b-47f1-ba9c-e6d0b0a59491 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090479 Aug 02 09:40:06.717710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1690/2753] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:06.722157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:06.722774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:06.728564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.729019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.729822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:06.730348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:06.792765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:06.800475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8aabdcda-5c96-43bc-b86c-70b92e30ac01 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081816 Aug 02 09:40:06.801047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1691/2754] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:07.207127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:07.207769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:07.213846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.214296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.215056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.215496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.344885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:07.352855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-154c5b12-cd24-489c-8d67-2c863a484469 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149732 Aug 02 09:40:07.353461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1692/2755] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:07.646975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:07.647591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:07.654162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.654623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.655384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.655826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.788381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:07.797011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f553c0cc-ec99-48ce-b7d4-ba8eef964eb0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153909 Aug 02 09:40:07.797617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1693/2756] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:07.802117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:07.802730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:07.808416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.808932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.810672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.811112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.873556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:07.881961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:07.883477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:07.884901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b2b05094-67de-4399-a58c-de43046803ce tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086359 Aug 02 09:40:07.885514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1694/2757] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:07.889935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:07.890547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:07.896328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.896773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.897622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:07.897995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:07.960374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:07.968717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b8c99d4b-2a87-4438-9627-6d44ae00bf63 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082266 Aug 02 09:40:07.969319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1695/2758] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:08.289922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 HTTP/1.1 Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:40:08.292177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:40:08.294535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '77bbf4ed-4629-41b6-b0c2-56aed8108028', 'id': '2c3324ae-90c8-4c69-920f-63141b54c5e5'} Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:40:08.295644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:40:08.296900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:40:08.298394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:40:08.299708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) Aug 02 09:40:08.301090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-01cb42a4-7b12-4f0e-a381-d66b6067f66d) {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5" status: 400 len: 269 microversion: 2.1 time: 132.034644 Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (ip 10.222.0.100) !!! Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:40:08 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 (10.222.0.100) Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: CRITICAL nova [None req-21238577-8d5f-47f2-9c27-0eeb91f1efac tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Unhandled error: OSError: write error Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova OSError: write error Aug 02 09:40:08.302445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova Aug 02 09:40:08.303071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1064/2759] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:37:56 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028/os-volume_attachments/2c3324ae-90c8-4c69-920f-63141b54c5e5 => generated 0 bytes in 132037 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Aug 02 09:40:08.374699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:08.375353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:08.381621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.382080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.382851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.383290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.518502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:08.525309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:08.525921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:08.526871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-83d3b6b1-5e00-4d07-8172-18831fee67e7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156097 Aug 02 09:40:08.527517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1696/2760] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:08.532900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.533487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.534354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.534852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.559582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:40:08.638046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-67afbe7d-386f-4cdd-aeaf-5ce03d2e8cd7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 204 len: 0 microversion: 2.1 time: 0.117513 Aug 02 09:40:08.638892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1065/2761] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:40:08 2022] DELETE /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:40:08.646875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:08.647500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:08.653845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.654594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.655056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.655497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.801730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:08.816296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f85f4633-9621-41d7-aecd-56d3077b09e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.173242 Aug 02 09:40:08.816896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1697/2762] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:08 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:08.820671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:08.822992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:08.829411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.829944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.830824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.831332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.907948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:08.908567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:08.914753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.915205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.915972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:08.916691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:08.978205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:08.989038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:08.989978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b76bbd7f-a457-45a4-915c-e763b6ad0102 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.174074 Aug 02 09:40:08.991548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1066/2763] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:08.997088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:08.997364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:08.999821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:09.005706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:09.005982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:09.006447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:09.006904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30a35f5c-5dd9-4634-bb9b-aaddd88ba6b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.103060 Aug 02 09:40:09.007674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1698/2764] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:09.008219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:09.009822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:09.092765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:09.100898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1cc457cd-4165-4666-b6e1-34e9631c83cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.108365 Aug 02 09:40:09.101495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1067/2765] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:09.550969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:09.551592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:09.557758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:09.558211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:09.559012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:09.559767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:09.692901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:09.702437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eb99c9cd-7688-4fab-95cf-f26a437f522e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155416 Aug 02 09:40:09.703099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1699/2766] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:09.844668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:09.845231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:09.851796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:09.852247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:09.853010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:09.853573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:09.985502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:09.993446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-869cafe5-5a26-429b-9c19-65dd973ef934 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153463 Aug 02 09:40:09.994040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1068/2767] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:09 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:10.013671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:10.014286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:10.020197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.020642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.021422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.021863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.032300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:10.032907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:10.038965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.039408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.040164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.040596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.102839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:10.111495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:10.112990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:10.114163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-112ce869-a2a3-4c85-8fe1-0c8ca43364f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086326 Aug 02 09:40:10.114724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1069/2768] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:10.126801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:10.127513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:10.133626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.134337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.135088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.135514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.154172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:10.162108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ae01847-f7ad-43cb-b2f9-7df5b1baad44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153172 Aug 02 09:40:10.162866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1700/2769] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:10.196682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:10.204971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ab04f076-894d-4d3b-9d3d-4d6aec89a77d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081830 Aug 02 09:40:10.205564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1070/2770] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:10.724077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:10.724692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:10.731777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.732392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.733163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:10.733598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:10.861728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:10.869617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-883595d3-8473-4449-a105-5300a0a2ccd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149391 Aug 02 09:40:10.870183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1701/2771] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:11.014665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:11.015282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:11.021652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.022098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.022855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.023281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.138088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:11.138717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:11.144709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.145203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.146015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.146449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.156250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:11.164337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1b16d747-2b5e-48dd-8830-8765c75fd783 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153786 Aug 02 09:40:11.164909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1071/2772] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:11 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:11.183518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:11.184112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:11.190348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.190802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.191574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.192014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.214142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:11.218122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:11.224486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:11.225999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:11.227136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d617b894-8be6-400f-b981-213c8a307952 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093663 Aug 02 09:40:11.227699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1702/2773] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:11.232634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:11.233298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:11.239392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.239842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.240606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.241140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.306175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:11.314302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-997c72b7-39ab-42e6-8877-1f4c8c6d7ad3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085611 Aug 02 09:40:11.314888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1703/2774] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:11.329704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:11.337581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c422def-2cdf-4cfa-945f-7f43c6d73b1f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157867 Aug 02 09:40:11.338140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1072/2775] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:11.891257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:11.891897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:11.898470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.898919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:11.899682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:11.900117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.031623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.039687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-217b2579-f798-40a5-bbd2-237570d94bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152383 Aug 02 09:40:12.040268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1704/2776] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:12.186046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:12.186584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:12.192871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.193351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.194101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.194559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.250835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:12.251493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:12.257612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.258136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.259189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.259633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.321828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.331692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.333216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.334434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aace7944-9eae-4a58-9b4a-03a009b7effa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087847 Aug 02 09:40:12.335023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1705/2777] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:12.339757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:12.341351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:12.347841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.348299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.349085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.349571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.420493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.428627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4a80a5f-0056-4f7f-bf66-d0ba934b12a9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.092551 Aug 02 09:40:12.429401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1706/2778] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:12.434450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:12.435054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:12.441384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.441860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.442728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:12.443211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:12.578296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.580283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:12.586339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-86095252-26d6-40d4-a725-ca41cc0090bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.404377 Aug 02 09:40:12.586912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1073/2779] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:12 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:12.588435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b213a24e-e39f-49eb-bd96-5b25da68d485 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158151 Aug 02 09:40:12.589146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1707/2780] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:13.060610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:13.061259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:13.067210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.067660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.068419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.068859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.196437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.204912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-21b8ce77-0196-4f7b-b86b-659491fbb565 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148380 Aug 02 09:40:13.205523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1074/2781] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:13.358735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:13.359344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:13.365889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.366339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.367100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.367533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.428759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.437967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.439481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.440621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c390b85-990f-4b34-8f5c-787fa59c75fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086334 Aug 02 09:40:13.441205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1708/2782] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:13.450688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:13.451233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:13.457227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.457670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.458425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.458857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.519453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.526833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-842e5158-7fd2-4a17-8a76-2a70c0616ef1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080693 Aug 02 09:40:13.527424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1075/2783] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:13.608055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:13.609690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:13.610303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:13.610431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:13.616406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.616574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.616866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.617028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.617662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.617838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:13.618101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.618338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:13.753278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.754274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:13.761634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b89c0214-16f1-4da3-97ce-34fe7e840b32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156138 Aug 02 09:40:13.762248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1076/2784] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:13.763016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c628dcad-0a18-4e6d-8183-3c915914db11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159310 Aug 02 09:40:13.763731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1709/2785] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:13 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:14.225983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:14.226584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:14.233578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.234040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.234836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.235273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.363605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.372508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-446db419-1184-4836-837d-13ed67fb0376 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150300 Aug 02 09:40:14.373087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1077/2786] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:14.464425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:14.465978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:14.472640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.473093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.473889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.474329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.536008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.544651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.546196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.547346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f578e77-479e-4f0c-9b6a-0f2f571bfbe5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087458 Aug 02 09:40:14.547918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1710/2787] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:14.548439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:14.549358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:14.555257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.555697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.556455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.556878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.617065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.625026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-53ae89fc-03d3-43b4-ac83-74e696ac678c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082348 Aug 02 09:40:14.625633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1078/2788] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:14.784617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:14.785200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:14.786854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:14.787475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:14.791381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.791945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.792599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.793034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.793515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.794138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.794729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:14.795170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:14.926742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.932957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:14.936005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d9656d65-246b-4f46-8a15-3b6e40a640f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156018 Aug 02 09:40:14.937284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1711/2789] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:14 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:14.937415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:14.942452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-22e52287-b991-405a-921a-85045fff8305 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159603 Aug 02 09:40:14.943012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1079/2790] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:15.394190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:15.394841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:15.401159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.401611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.402361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.403364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.534891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:15.542843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cfc0ab9a-5b96-4867-86c2-3f4e24e99ce1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152571 Aug 02 09:40:15.543984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1712/2791] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:15.570526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:15.571136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:15.578805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.579256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.580026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.580462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.643324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:15.646812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:15.647375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:15.651905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:15.653993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:15.654303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.654771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.655137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-757371c5-7aac-4f0f-b01e-695373b8dc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088835 Aug 02 09:40:15.655538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.669145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1080/2792] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:15.669323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.719388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:15.726781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02976d3f-e490-4d27-8fa8-e0fd6c788505 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083913 Aug 02 09:40:15.727351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1713/2793] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:15.958507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:15.959126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:15.963775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:15.964543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:15.966036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.966510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.967306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.967740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.971343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.971801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:15.972572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:15.973049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.098010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.104348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.105997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7228d71a-70a7-4a7b-a6fa-baabe096bbad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151307 Aug 02 09:40:16.106584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1081/2794] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:15 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:16.112603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e9c40da1-7faf-4118-b101-1cd82bc279c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152912 Aug 02 09:40:16.113199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1714/2795] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:16.565394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:16.566039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:16.572085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:16.572630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.573308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:16.573744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.680449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:16.681310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:16.690460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:16.690910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.691691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:16.692126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.708498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.717009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aee1a32e-74d0-4441-9b2f-82c12b212a33 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155487 Aug 02 09:40:16.717608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1082/2796] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:16.748542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:16.749225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:16.755053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.755205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:16.755631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.756402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:16.756844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:16.763825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.765384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.766533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dea92fb-fdf5-491b-a3b6-411443ab9756 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090809 Aug 02 09:40:16.767098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1715/2797] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:16.818785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:16.826479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-239be163-f400-446a-8578-001ef3ac0c50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082555 Aug 02 09:40:16.827042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1083/2798] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:17.127025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:17.127561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:17.133580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.134290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.134426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:17.134932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:17.135050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.135460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.140853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.141348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.142120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.142559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.265687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.273698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b0718edd-29b8-41fa-b145-0490e78891b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150636 Aug 02 09:40:17.275367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.277486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1716/2799] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:17 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:17.284022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3c0bd0a9-c735-41fc-9407-f5a1934d4ace tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153810 Aug 02 09:40:17.284582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1084/2800] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:17.739358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:17.739973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:17.747168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.747609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.748367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.748801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.789496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:17.790113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:17.796809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.797303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.798079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.798513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.864043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.873150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.874662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.875820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fe9fec1d-0193-4b5e-87b6-289c51a97267 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090230 Aug 02 09:40:17.876389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1085/2801] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:17.880853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:17.881510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:17.886611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.888495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.888947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.889826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:17.890273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:17.895785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6943624f-221e-4ae2-be97-59f98a9dfbf6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160262 Aug 02 09:40:17.896359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1717/2802] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:17.952163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:17.959709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-be6fcace-c786-4892-98b2-efac98e5f783 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082381 Aug 02 09:40:17.960282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1086/2803] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:18.295834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:18.296452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:18.302692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.303140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.303907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.304374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.305833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:18.306468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:18.313776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.314233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.315004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.315444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.437427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:18.445435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3756c4f1-a30f-458a-b3f0-1f7a6f014531 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153928 Aug 02 09:40:18.446009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1718/2804] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:18 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:18.447050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:18.455384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-281e28ab-d027-4c5c-a8ed-11a00d362b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153431 Aug 02 09:40:18.455941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1087/2805] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:18.900244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:18.900791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:18.908092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.908546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.909360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.909799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.916633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:18.917267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:18.924168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.924616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.925415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.925847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.928775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:18.974082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:18.982758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:18.984316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:18.985484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9095e10b-ec8d-430a-8253-3e03225302a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089316 Aug 02 09:40:18.986052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1719/2806] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:18.990407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:18.991014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:18.997098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.997579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:18.998342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:18.998777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:19.067246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:19.069616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:19.076072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-66bb8235-05c6-4c74-88d3-e07ef5579acd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089034 Aug 02 09:40:19.076655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1720/2807] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:19.078254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-02fdf5ed-fa0a-459b-a116-8c4c8edb836c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.165462 Aug 02 09:40:19.078825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1088/2808] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:19.467735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:19.468339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:19.471251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:19.475092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:19.475543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:19.476300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:19.476730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:19.477062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:19.477705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:19.483893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:19.484346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:19.485137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:19.485568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:19.611258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:19.613600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:19.619344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d6eb52a4-d531-4ff2-81fc-eca2f919db6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155601 Aug 02 09:40:19.619933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1721/2809] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:19 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:19.622572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3767fbb8-57e6-4886-8cd2-8e853dd10e65 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149350 Aug 02 09:40:19.623140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1089/2810] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:20.007906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:20.008646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:20.017854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.018313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.019095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.019540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.081943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.090890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.092428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.093633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a900707d-2d2e-47c9-bb0e-b504ac58fbc9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089671 Aug 02 09:40:20.097325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:20.097948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1722/2811] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:20.098084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:20.102638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:20.103328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:20.104555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.104997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.106536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.107099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.110178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.110626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.111394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.111828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.172683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.180424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-311a48d6-6064-4fe1-9a80-7ed4102471a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087081 Aug 02 09:40:20.181008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1090/2812] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:20.243620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.251661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c85f110-e901-41d2-93c7-fcea60b24ed7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152695 Aug 02 09:40:20.252232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1723/2813] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:20.641625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:20.642242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:20.643859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:20.644492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:20.648343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.648842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.649642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.650082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.650370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.650815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.651569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:20.651996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:20.780624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.780835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:20.788691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b90ec48a-32ea-4fdb-af55-cad4020ab8c7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151717 Aug 02 09:40:20.788852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32b8998b-480b-42d7-9b13-10ca6c01d6bb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148793 Aug 02 09:40:20.789321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1091/2814] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:20 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:20.789458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1724/2815] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:21.116847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:21.117558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:21.124761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.125242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.126008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.126449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.187959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.196384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.197940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.199093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc444b2f-d4df-4f44-aa82-5dfc7cfbc6c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086178 Aug 02 09:40:21.200195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1092/2816] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:21.202071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:21.202686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:21.209261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.209706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.210473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.210907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.273827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:21.274353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.274480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:21.281002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.281493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.282023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-757fa374-9ee8-4654-9d47-5fa9dfe83573 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084703 Aug 02 09:40:21.282264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.282597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1725/2817] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:21.282726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.413016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.421507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63f9f4be-2ab4-48c4-b7f2-069984988644 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151489 Aug 02 09:40:21.422082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1093/2818] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:21.810347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:21.810532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:21.810870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:21.810997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:21.817424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.817998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.818161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.818883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.819035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.819510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.820099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:21.820542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:21.951947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.955744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:21.960058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7928d2d8-3347-44c1-ae32-0be502bd5331 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153965 Aug 02 09:40:21.960634 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1094/2819] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:21.963914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-487d96e8-8493-4fdf-981d-fcac2cea891e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.158396 Aug 02 09:40:21.964553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1726/2820] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:21 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:22.222342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:22.222886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:22.229311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.229769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.230580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.231220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.296412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:22.303804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:22.304429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:22.305017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:22.306570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:22.307734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-129f46cf-583b-4ffe-b01b-42bf229d6c09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089401 Aug 02 09:40:22.308351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1095/2821] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:22.311679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.312211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.313055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.313734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.375389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:22.382892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34898c89-1a06-4c96-97cb-cbb3d8efaf9f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083012 Aug 02 09:40:22.383463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1727/2822] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:22.442545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:22.443151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:22.449141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.450535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.451211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.451641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.476860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:22.592223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:22.600182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-30ea25f1-52fc-44b4-bdaf-6782033c6ab6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.161490 Aug 02 09:40:22.600746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1096/2823] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:22.982697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:22.983369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:22.985347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:22.985969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:22.989830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.990676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.992051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.992509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.992744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.993440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:22.993797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:22.993937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.132840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.141450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d7e8da99-d481-44d6-b068-302a9701019d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.163383 Aug 02 09:40:23.142034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1728/2824] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:23.235620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.243682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ffea5dd0-cd3a-437b-be36-d906536f8729 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.262674 Aug 02 09:40:23.244251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1097/2825] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:22 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:23.331235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:23.331855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:23.338381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:23.338827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.339591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:23.340779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.404606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:23.406056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:23.408335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.412269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:23.412727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.413528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:23.413974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.417460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.419709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.420881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1234358d-7307-4572-86be-47de97f792da tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093714 Aug 02 09:40:23.421679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1729/2826] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:23.486207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.493600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c8467274-18c6-4bef-a792-53b20f6a9d4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.093444 Aug 02 09:40:23.494170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1098/2827] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:23.626430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:23.627378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:23.633402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:23.634101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.634868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:23.635299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:23.763020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:23.770967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-baa1e273-5776-445a-be8a-c120f05f7ff7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151591 Aug 02 09:40:23.771533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1730/2828] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:24.163318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:24.163937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:24.170300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.170745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.171554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.171941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.266407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:24.267127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:24.273086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.273565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.274323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.274755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.301287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.309617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15a3f3f4-a0f2-481a-b47a-bfc666a26e93 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150153 Aug 02 09:40:24.310245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1099/2829] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:24.403640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.411528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-50fa19a9-5ead-487d-ace7-11bc5df99427 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149635 Aug 02 09:40:24.412089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1731/2830] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:24 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:24.443905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:24.444447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:24.451167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.451623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.452392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.452861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.516260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:24.516659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:24.518049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.522828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.523280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.524056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.524494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.526540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.528057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.529256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9fffd71a-c177-463f-a5b6-610ee98c2147 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089321 Aug 02 09:40:24.529818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1100/2831] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:24.589939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.597676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-58a23a17-b533-4604-a48d-ed81d235a590 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086171 Aug 02 09:40:24.598254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1732/2832] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:24.792397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:24.793689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:24.799702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.800154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.800911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:24.801382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:24.930890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:24.939659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1aaa9d6b-e968-4a10-9851-3a06deb2787d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151131 Aug 02 09:40:24.940231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1101/2833] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:25.330862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:25.331475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:25.338090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.338545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.339311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.340287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.432736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:25.433370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:25.440221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.440670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.441462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.441893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.469849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:25.477977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eb7f7eed-ae95-4a66-91b4-64fc1853434f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150954 Aug 02 09:40:25.478657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1733/2834] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:25.555901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:25.556511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:25.563155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.563606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.564364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.564813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.574228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:25.582378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2bb6e3e-87e2-491a-acc5-f0719bb26d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153359 Aug 02 09:40:25.583079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1102/2835] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:25 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:25.618120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:25.618728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:25.625663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.626114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.626886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.627321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.627450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:25.636087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:25.637859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:25.639013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9d63d4b7-7e8b-4d19-8cfd-0d8eb8a634c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087120 Aug 02 09:40:25.639611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1734/2836] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:25.687833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:25.695180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c685b7f-6a10-424d-b32e-51b7e875bd9e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080922 Aug 02 09:40:25.695743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1103/2837] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:25.961320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:25.961936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:25.968471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.968917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:25.969715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:25.970152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.100492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.109140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4b0ee0e1-c976-48f2-a4cd-febfad28518d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151741 Aug 02 09:40:26.109715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1735/2838] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:26.499884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:26.500497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:26.507002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.507500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.509874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.510316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.602913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:26.603558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:26.609995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.610439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.611200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.611626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.615621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:26.653100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.661317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1116fd6a-2cf8-4dc5-ad6f-a5b627e8b81c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.165370 Aug 02 09:40:26.666437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1104/2839] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:26.667475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:26.667475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:26.674272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.674723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.675489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.675919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.740778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.748409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.750012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.751532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.752690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-857c7b0b-bf8c-44c5-982c-eb965c61ed73 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089798 Aug 02 09:40:26.753320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1105/2840] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:26.756730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b98ac14-d303-4499-8665-37249bcde3b6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157879 Aug 02 09:40:26.757331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1736/2841] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:26 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:26.762358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:26.762973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:26.769025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.769523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.770353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:26.770876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:26.831254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:26.838724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3cbd9145-5aa4-4d69-be06-12f8c447cd90 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080455 Aug 02 09:40:26.839292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1106/2842] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:27.130514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:27.131124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:27.137592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.138041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.138797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.139231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.265682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.273618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-06399a7f-e013-418d-9e48-e08c8ccc38db tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147009 Aug 02 09:40:27.274183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1737/2843] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:27.682802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:27.683402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:27.689961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.690410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.691166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.691604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.776239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:27.776813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:27.784443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.784899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.785693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.786132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.823778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.832664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e20c4fcb-015f-41db-a377-faf3591cbf5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153677 Aug 02 09:40:27.833272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1107/2844] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:27.837881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:27.838496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:27.844943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.845443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.846214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.846660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.852252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.860977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.862541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.863687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3d76c48-367b-4c2f-bd96-5f224ef098c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091613 Aug 02 09:40:27.864247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1738/2845] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:27.868763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:27.869461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:27.875795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.876238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.876991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:27.877532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:27.944748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.953148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9d40e561-c9b3-4038-9d28-d7ed9ef81984 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087893 Aug 02 09:40:27.954194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1739/2846] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:27.987230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:27.995177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ca3aae3-b81d-4bd3-9ec3-9cb769bf5802 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160956 Aug 02 09:40:27.995742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1108/2847] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:27 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:28.296135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:28.296772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:28.302865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:28.303316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:28.304075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:28.304514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:28.432119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:28.440617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-757c2afb-4020-45b8-b317-747e7addebe0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149078 Aug 02 09:40:28.441209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1740/2848] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:28.854767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:28.855463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:28.862643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:28.863102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:28.863869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:28.864306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:28.888568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:28.889253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:28.895719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:28.896252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:28.897085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:28.897755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:28.970719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:28.981057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:28.982674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:28.983862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-af77c1ed-6d57-4a11-aacd-f44703688ed1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.099922 Aug 02 09:40:28.984647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1741/2849] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:29.000835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:29.001506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:29.007619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:29.008076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:29.009147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:29.009582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:29.009720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:29.018644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f3733b6e-e493-4d9d-a470-8e12644e1d35 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.167815 Aug 02 09:40:29.019217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1109/2850] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:29.023723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:29.024336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:29.030871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:29.031388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:29.032167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:29.032608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:29.076035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:29.084421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87166b5a-1f8b-49c9-928f-ac03c973abbe tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087909 Aug 02 09:40:29.085452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1742/2851] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:29.169601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:29.177704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-02f34465-e4ec-4c51-ba81-e6f1f734ec78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157391 Aug 02 09:40:29.178278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1110/2852] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:29 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:29.462207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:29.462819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:29.469574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:29.470035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:29.470776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:29.471202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:29.602345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:29.610336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0de28390-d5cd-4d84-a1a2-a14cc794cf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151970 Aug 02 09:40:29.610906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1743/2853] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:30.006577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:30.007193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:30.010851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:30.015162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.015621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.016396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.016837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.040051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:30.040671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:30.048257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.048738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.049552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.049993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.079341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.087796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.089325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.090840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b54b9d3e-7548-4796-980d-a005cb33a160 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088131 Aug 02 09:40:30.091402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1111/2854] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:30.105971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:30.107142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:30.113623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.114076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.114853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.115294 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.178827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.186376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-01220c43-3853-42bf-89ab-3090803a9e57 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084650 Aug 02 09:40:30.186529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.186962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1112/2855] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:30.194643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ea3f4033-6dc3-4582-8c8c-692ac18f7bbe tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158402 Aug 02 09:40:30.205127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1744/2856] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:30 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:30.205312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:30.205312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:30.205684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.206136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.206899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.207339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.211249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:30.338584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.347169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3265bbf7-7610-481c-b2b3-51744547cfaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152165 Aug 02 09:40:30.347731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1113/2857] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:30 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:30.634554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:30.635162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:30.641904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.642340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.643094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:30.643518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:30.770285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:30.778847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-88da8c1e-87ec-4bc0-a688-ead50f8c0ca2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148407 Aug 02 09:40:30.779418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1745/2858] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:31.114590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:31.115228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:31.122201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.122654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.123417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.123860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.184926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.193492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.195009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.196169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-953291e9-ff5a-4e18-baed-7227e51f1c34 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085625 Aug 02 09:40:31.196735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1114/2859] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:31.207294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:31.207906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:31.216221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:31.217066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:31.218369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.218855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.219616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.220092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.224042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.224498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.225299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.225735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.286452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.294715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8fde6001-fe4e-4b7d-b43c-356ce6d28226 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.091202 Aug 02 09:40:31.295297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1746/2860] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:31.354917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.364035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bf82beb3-236b-4dc8-8a52-37c792dcfde1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151753 Aug 02 09:40:31.364385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1115/2861] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:31.368923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:31.369624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:31.376341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.376789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.377603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.378046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.510419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.518340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e05b14fa-c944-4be8-b88a-cccc4dfd8e81 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153243 Aug 02 09:40:31.518905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1747/2862] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:31 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:31.799997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:31.800607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:31.806809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.807252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.807999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:31.808431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:31.941644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:31.949505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6f2286b1-20ed-48e3-bcc6-4e535571eee3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153366 Aug 02 09:40:31.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1116/2863] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:32.221803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:32.222335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:32.228808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.229297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.230070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.230507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.294271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:32.302696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:32.304197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:32.305379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-733a316f-1888-4f3c-8d04-2aac0702f2fb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087583 Aug 02 09:40:32.305941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1748/2864] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:32.315337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:32.315972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:32.322709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.323190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.324743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.325251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.386298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:32.386977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:32.387626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:32.393724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.394173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.394758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bcbd34f4-3b48-434a-a078-bbcc4d1931e7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083315 Aug 02 09:40:32.394942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.395382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.395600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1117/2865] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:32.523086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:32.531570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5214a052-9059-4ffc-96ef-53ec56e4d686 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149498 Aug 02 09:40:32.532143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1749/2866] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:32.538972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:32.539586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:32.546854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.547312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.548119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.548560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.683047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:32.691701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aeed92fd-ef68-431d-8c4e-fadffc7a0a29 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156588 Aug 02 09:40:32.692274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1118/2867] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:32 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:32.971327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:32.971950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:32.978167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.978623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:32.979396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:32.980941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.110587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.118611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-27e4c24f-b292-4d14-b1eb-05cd827717b1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151173 Aug 02 09:40:33.119181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1750/2868] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:33.328301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:33.328916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:33.335384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.335839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.336606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.337050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.398462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.407562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.409129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.410278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-900bd015-407c-4c65-ab29-9e4018a39970 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085913 Aug 02 09:40:33.410843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1119/2869] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:33.416677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:33.417328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:33.424352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.424799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.425590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.426026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.487492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.495002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-862a6ecd-9040-4e66-acd3-bb7d99803c7a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082226 Aug 02 09:40:33.495583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1751/2870] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:33.553400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:33.554016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:33.560182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.561025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.561292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.561733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.688137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.695991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d25da69d-425e-440c-9f13-514316d7e8ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146565 Aug 02 09:40:33.696551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1120/2871] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:33.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:33.713621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:33.720209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.720657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.721452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:33.721891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:33.848697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:33.852191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:33.858111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-389634ce-3fcd-4ef4-a047-ced8ddc56776 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148979 Aug 02 09:40:33.858691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1752/2872] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:33 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:34.140857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:34.141511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:34.147518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.147968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.148740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.149215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.278241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:34.286090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-38264d1d-2ac4-46ac-b313-f8e83e3793ab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149840 Aug 02 09:40:34.286650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1121/2873] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:34.434654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:34.435303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:34.441842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.442296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.443064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.443503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.507433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:34.515745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:34.516359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:34.516497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:34.518012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:34.519169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87dae3fa-5976-4909-84b3-5d1b7dcc892f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089546 Aug 02 09:40:34.519739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1753/2874] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:34.523234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.523685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.524455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.524891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.588078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:34.595671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b5a0bfff-cc98-4dfb-b7b7-0055fb95b5d3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083826 Aug 02 09:40:34.596238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1122/2875] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:34.719102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:34.719748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:34.725903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.726356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.727118 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.727556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.857379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:34.865294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0ae4f41-1dab-49a1-a4ee-5029aef58e11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150650 Aug 02 09:40:34.865878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1754/2876] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:34.879638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:34.880253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:34.886743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.887257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:34.887950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:34.888396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.016502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:35.024599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad7cceea-f456-4084-a02d-b2375382951d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148801 Aug 02 09:40:35.025182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1123/2877] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:34 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:35.307715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:35.309148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:35.315176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.315618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.316372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.316802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.444903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:35.453202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0067686a-4db0-4e7f-95a3-af33c553facb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149298 Aug 02 09:40:35.453783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1755/2878] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:35.541756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:35.542360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:35.549469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.549912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.550665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.551102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.611212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:35.616820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:35.617451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:35.619667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:35.621218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:35.622538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ae8f7499-bc19-4441-b63b-09d001e90da1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084661 Aug 02 09:40:35.623099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1124/2879] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:35.623542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.623989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.624747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.625201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.688686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:35.696202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df62bcfe-066b-488e-931b-8d31136c2f32 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083177 Aug 02 09:40:35.696772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1756/2880] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:35.887499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:35.888037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:35.894227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.894689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:35.895432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:35.895862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.028671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.036653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfe6edfc-3697-4768-b699-edd8c432485f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153908 Aug 02 09:40:36.037244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1125/2881] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:36.045882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:36.046508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:36.052502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.052954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.053874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.054315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.181882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.189749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4f4cc77e-3a9b-43f4-9c34-49eb8a83a96d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147899 Aug 02 09:40:36.190317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1757/2882] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:36 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:36.475928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:36.476482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:36.482777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.483233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.484001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.484441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.615856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.624431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8304e38b-5488-4d27-8cb9-06b78b9f01a0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152460 Aug 02 09:40:36.625000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1126/2883] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:36.645493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:36.646113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:36.652649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.653222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.653918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.654359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.717409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:36.718018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:36.723698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.724405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.724854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.725645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:36.726136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:36.732222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.733744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.734882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-edd86442-a58f-4c62-8b8d-21601c485b0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093337 Aug 02 09:40:36.735446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1758/2884] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:36.790616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:36.798678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d073678-c5b7-4dd1-9ee1-4c09d4f41437 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085523 Aug 02 09:40:36.799248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1127/2885] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:37.057471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:37.058639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:37.064720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.065214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.065985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.066424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.197524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.205806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe36fb40-bf6d-45b4-b70d-6e0909a678e5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152327 Aug 02 09:40:37.206398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1759/2886] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:37.211243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:37.211865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:37.218100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.218552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.219344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.219783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.348871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.357703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eeae1f07-2065-4a9a-8c8a-80955be5271b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150381 Aug 02 09:40:37.358272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1128/2887] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:37 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:37.647410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:37.647966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:37.655353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.655802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.656571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.657043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.758044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:37.758677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:37.766957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.767410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.768189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.768630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.784870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.793071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a4c6301-c69b-4688-90db-61da0804c640 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149388 Aug 02 09:40:37.793741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1760/2888] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:37.819691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:37.820300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:37.827188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.827638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.828402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:37.829041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:37.831227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.834617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:37.840363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.841926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.843080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0483268e-2f5e-4555-94c0-08f0e6287de7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088943 Aug 02 09:40:37.843677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1129/2889] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:37.890478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:37.898052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e52cf885-5ec6-41b2-bfa6-bb5d844241ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082255 Aug 02 09:40:37.898565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1761/2890] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:38.227443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:38.227982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:38.234081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.234540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.235302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.235745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.364977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:38.373629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-928d0293-41df-41c2-941f-9ff665036645 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150346 Aug 02 09:40:38.374200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1130/2891] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:38.379089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:38.379743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:38.386706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.387478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.388253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.388699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.517177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:38.525156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b2108005-1a95-44bb-943b-efccbbd82989 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149960 Aug 02 09:40:38.525737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1762/2892] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:38 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:38.814849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:38.815380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:38.821954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.822414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.823177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.823715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.866355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:38.867133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:38.873773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.874229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.875003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.875444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.939068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:38.947701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:38.949507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:38.950669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-794c57ef-727a-48dc-950b-cfa532784c60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088225 Aug 02 09:40:38.951247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1763/2893] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:38.955745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:38.956360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:38.960231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:38.962357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.962794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.963564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:38.964009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:38.970774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4dc57f6-9450-42ce-b49e-4e0bb9238d58 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159822 Aug 02 09:40:38.971417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1131/2894] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:39.026249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:39.034472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3df95e44-8ae9-4f4b-88e6-0fb428c4ca74 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082270 Aug 02 09:40:39.035044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1764/2895] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:39.395483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:39.396134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:39.402755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:39.403212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:39.403978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:39.404417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:39.531588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:39.539604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ae2672e5-4740-451f-a520-18d81b898d55 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148000 Aug 02 09:40:39.540163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1132/2896] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:39.545961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:39.546582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:39.552544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:39.552998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:39.553792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:39.554231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:39.685706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:39.693653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f499b4d4-bbde-45bb-834e-0519571684ee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151637 Aug 02 09:40:39.694230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1765/2897] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:39 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:39.974559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:39.975168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:39.982291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:39.982734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:39.983482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:39.983913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:39.991782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:39.992404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:40.000056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.000503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.001319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.001759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.048797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.057390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.059491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.060635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c84d049d-e768-459f-969c-6a5bf1159c3b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090019 Aug 02 09:40:40.061209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1133/2898] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:40.065721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:40.066318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:40.072697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.073229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.074069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.074501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.133550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.135469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.142099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3905b281-d28d-49f9-9e31-15a66d182cb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154202 Aug 02 09:40:40.142683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1766/2899] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:40.143155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4287e0a9-4b59-464d-9149-f129e158bc3b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080989 Aug 02 09:40:40.143963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1134/2900] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:40.559954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:40.560571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:40.566628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.567083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.567851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.568290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.699294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.707796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db6f18c0-e6ab-4e1f-a07d-f304211f9735 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151873 Aug 02 09:40:40.708375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1767/2901] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:40.717390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:40.718047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:40.724026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.724484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.725286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:40.725723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:40.854050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:40.862212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bec21e22-3c50-47f2-823e-f92c97d2fc3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150266 Aug 02 09:40:40.862776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1135/2902] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:40 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:41.083813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:41.084426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:41.091103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.091546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.092298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.092728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.156459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:41.163525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:41.164179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:41.165034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:41.166560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:41.167703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b644e21-77b2-419e-bf3b-b3ea1b37ad51 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087835 Aug 02 09:40:41.168258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1768/2903] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:41.170766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.171254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.172004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.172605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:41.172871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.173230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:41.179222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.179666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.180422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.180854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.199808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:41.243629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:41.252047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5684c242-22ec-4325-9762-3868a864c6f9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082828 Aug 02 09:40:41.252820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1769/2904] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:41.306815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:41.315536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ba7d7bec-3125-4411-96fd-9ffb32ba92f1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155778 Aug 02 09:40:41.316114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1136/2905] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:41.730994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:41.731548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:41.737653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.738107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.738872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.739311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.867275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:41.875363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8767db5-afaa-42a2-a9e1-8b7e595eac82 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148904 Aug 02 09:40:41.875942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1770/2906] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:41.883255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:41.884172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:41.890910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.891359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:41.892122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:41.892549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.022283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:42.030950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3292123d-5b80-4ae9-a10f-165924b24a8c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151535 Aug 02 09:40:42.031506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1137/2907] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:41 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:42.190629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:42.191277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:42.194640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:42.199094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.199549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.200317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.200757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.261953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:42.270441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:42.271893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:42.273055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5fad4aa2-a036-4206-be56-b06d60d70ae0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086474 Aug 02 09:40:42.273642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1771/2908] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:42.273824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:42.274575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:42.282102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.282548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.283309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.283739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.338142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:42.338767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:42.346052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.346510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.347288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.347619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:42.347816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.355466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-740af349-8578-48ff-bfe5-8b4f20fe2920 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085619 Aug 02 09:40:42.356030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1138/2909] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:42.479455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:42.487706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9a456d72-de54-4fa1-a016-80aeb0044afd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153510 Aug 02 09:40:42.488276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1772/2910] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:42.897496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:42.898116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:42.904251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.904703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:42.905500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:42.905945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.038931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.047783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-57aed709-7a54-4fb8-b81b-74b2d560625d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154159 Aug 02 09:40:43.048513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1139/2911] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:43.052415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:43.053037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:43.059947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.060421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.061225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.061668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.189857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.198245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e20c9def-1e28-4269-90e8-0940ed9a3e93 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149666 Aug 02 09:40:43.198967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1773/2912] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:43.296333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:43.296951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:43.303353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.303805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.304571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.305017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.367402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.376018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.376214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:43.376706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:43.377578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.378735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dbc1ac38-088f-4e30-aba8-acbc99553b44 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086854 Aug 02 09:40:43.379511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1140/2913] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:43.382981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.383430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.384498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.384935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.448651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.456295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-856b299a-1565-4a93-af2c-eaeb5d183f50 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084171 Aug 02 09:40:43.456861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1774/2914] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:43.509463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:43.510074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:43.516761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.517248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.518007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:43.518470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:43.644840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:43.652823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-20378061-a881-4ff4-8681-57e0fd1b37de tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147445 Aug 02 09:40:43.653447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1141/2915] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:44.069511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:44.070134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:44.076175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.076626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.077427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.077874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.204388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.212321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-91280a77-22c4-4e0e-bdda-878d87f5eb36 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146790 Aug 02 09:40:44.212887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1775/2916] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:44.219932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:44.220600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:44.226584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.227040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.227800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.228241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.361870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.369685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-363eb12b-965b-465b-8719-6bfebf21ccb1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153632 Aug 02 09:40:44.370807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1142/2917] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:44 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:44.401396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:44.402249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:44.408120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.408563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.409359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.409793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.471084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.478003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:44.478646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:44.480287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.481971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.483112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-873688e6-e05c-43fe-8bef-2f0475cf018f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085691 Aug 02 09:40:44.483680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1776/2918] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:44.485193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.485645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.486422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.486862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.547466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.555066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1c3606b7-c3ec-4876-b753-88557cd0b470 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080922 Aug 02 09:40:44.555631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1143/2919] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:44.674520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:44.674783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:44.680923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.681407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.682176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:44.682617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:44.822603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:44.830709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0c1f39bd-142e-4b2b-8b5a-fbf67d27e0c7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160414 Aug 02 09:40:44.831287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1777/2920] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:45.234031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:45.234568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:45.240527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.240981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.241784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.242218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.369755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.377876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-950e4aa0-5235-436a-a150-5836593176ee tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147813 Aug 02 09:40:45.378445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1144/2921] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:45.392332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:45.392946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:45.399398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.399847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.400606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.401040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.506127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:45.506869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:45.513732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.514189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.514960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.515401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.532127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.540206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b60c7ea4-5ab1-4535-85ea-8f0e6dc51986 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151722 Aug 02 09:40:45.540791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1778/2922] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:45.577023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:45.577827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:45.580956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.584053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.584512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.585313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.585753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.589825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.591351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.592507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ea181131-910e-4ec2-ba20-c7400ff28ff3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090355 Aug 02 09:40:45.593065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1145/2923] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:45.646531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.655273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aef03562-ebac-4573-a97a-80c3908e580f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083110 Aug 02 09:40:45.655884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1779/2924] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:45.852136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:45.852683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:45.858757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.859203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.859965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:45.860400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:45.878614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:45.990442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:45.999073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6cf1d711-8b62-4bfb-8531-e89a68de4d37 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150876 Aug 02 09:40:45.999645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1146/2925] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:46.400295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:46.400893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:46.408026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.408476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.409279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.409716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.539920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:46.548467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e73d134a-f3fd-4ef2-9cd4-e4dcbaf3c677 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152112 Aug 02 09:40:46.549037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1780/2926] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:46.561526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:46.562255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:46.568642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.569091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.569895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.570318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.615598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:46.616215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:46.622317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.622747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.623518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.623948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.686624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:46.696977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:46.699782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:46.700986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-473e7b67-b3e5-4bfb-9ff0-24f44184dda1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089337 Aug 02 09:40:46.701640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1781/2927] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:46.706185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:46.706794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:46.711511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:46.713048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.713618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.715045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:46.715779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:46.721647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fd75715c-d05f-4768-92f3-c93c98c60fc8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.164165 Aug 02 09:40:46.722254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1147/2928] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:46 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:46.779284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:46.786718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f9e5dd8-92e3-42ac-9574-5db812a89b8b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084122 Aug 02 09:40:46.787316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1782/2929] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:47.020194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:47.020810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:47.027665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.028108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.028865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.029332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.158321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.166773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2f3ee496-b9d1-4ed0-9f49-03586c1d0ce4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150481 Aug 02 09:40:47.167622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1148/2930] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:47.569825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:47.570437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:47.577174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.577637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.578404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.578846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.707605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.715869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b665c80-37d7-460d-9f1b-fb4a9326ec94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150020 Aug 02 09:40:47.716440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1783/2931] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:47.724133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:47.724842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:47.732511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.732962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.733784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.734226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.742652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:47.743277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:47.750113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.750567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.751343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.751782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.799010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.807631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.809282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.810440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6b2218fd-7083-49a8-86de-193b3f89c8ef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090241 Aug 02 09:40:47.811009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1149/2932] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:47.815430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:47.816040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:47.821904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.822302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.823063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:47.823645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:47.885583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.886515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:47.893625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21b4011d-962c-474c-9f20-a8788e684bc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154915 Aug 02 09:40:47.894118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-398cf681-c2ce-49bd-8dfe-123406f31a62 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082083 Aug 02 09:40:47.894228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1784/2933] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:47 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:47.894791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1150/2934] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:48.187113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:48.187657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:48.193652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.194093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.194838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.195269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.321421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:48.330120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8bc2055a-1870-4d74-bfaf-7d3eb69bafdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146951 Aug 02 09:40:48.330683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1785/2935] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:48.737967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:48.738606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:48.744967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.745945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.746693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.747128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.833921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:48.834531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:48.841962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.842411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.843179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.843612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.847691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:48.879015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:48.888553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-134db3cf-ce04-4fd4-aa03-23db8998dd04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155329 Aug 02 09:40:48.889161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1151/2936] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:48.910360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:48.915418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:48.916086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:48.920691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:48.922327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:48.923044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.923411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ec9b80d3-e73b-4422-8e26-96030ded5bff tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093404 Aug 02 09:40:48.923551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.924210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1786/2937] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:48.928569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:48.928702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.929140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.929278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:48.940289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.940797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:48.941649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:48.942091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:49.003743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:49.012035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bad49b53-186f-4301-a6cf-ca1cee5b3545 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086938 Aug 02 09:40:49.012622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1787/2938] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:49.059405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:49.067177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b67cf033-2d78-4ebd-9cc1-a30b8237f337 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155624 Aug 02 09:40:49.067739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1152/2939] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:48 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:49.351619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:49.352237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:49.358902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:49.359354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:49.360112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:49.360546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:49.487578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:49.495592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-88229508-8cae-47ac-a3b6-ee737d55d340 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147835 Aug 02 09:40:49.496192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1788/2940] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:49.909979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:49.910588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:49.917880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:49.918343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:49.919169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:49.919614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:49.947103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:49.947719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:49.955100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:49.955555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:49.956334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:49.956777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.019675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.029518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.031084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.032261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8626faaa-b6dd-4d91-b8a8-e4a4f7be05db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089093 Aug 02 09:40:50.032823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1789/2941] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:50.037360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:50.038750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:50.044648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:50.045101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.046153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:50.046406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.055923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.064626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-29365204-4cc4-44fb-a6dd-03894b6fde22 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158528 Aug 02 09:40:50.065246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1153/2942] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:50.087704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:50.088316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:50.095190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:50.095641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.096411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:50.096844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.111571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.119402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bad6c1fa-872e-46ce-89f5-63b693c38409 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085593 Aug 02 09:40:50.120511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1790/2943] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:50.224226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.232126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d7c52bd5-ef53-4b48-8151-ea5a85265786 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148306 Aug 02 09:40:50.232699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1154/2944] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:50.517057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:50.517691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:50.523659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:50.524099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.524847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:50.525378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:50.654621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:50.662457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e87f4ae4-37b4-4368-984d-ec614576e104 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149318 Aug 02 09:40:50.663020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1791/2945] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:51.055204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:51.055816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:51.062330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.062780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.063543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.063981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.086364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:51.086989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:51.094070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.094523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.095295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.095735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.125775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.134447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.136573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.137782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eff5ba7a-b749-435f-8a36-c2478f49048f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086508 Aug 02 09:40:51.138508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1155/2946] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:51.142892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:51.143498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:51.149365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.149811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.150565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.150997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.220051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.229020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a93878f9-ad68-4aa2-8622-a00ba351153e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089619 Aug 02 09:40:51.229687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1156/2947] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:51.231614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.239594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4941e908-379b-4657-8fe7-977a07b094cd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157106 Aug 02 09:40:51.240197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1792/2948] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:51.253676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:51.254325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:51.261028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.261588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.262359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.262798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.391729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.399591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2b927f5a-24e9-44dc-a3de-4a39aa3350a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149743 Aug 02 09:40:51.400156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1157/2949] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:51.684946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:51.685603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:51.691735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.692187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.692949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:51.693419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:51.822507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:51.832167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-85a80713-ced2-47a5-a3f6-a9178dac024f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152145 Aug 02 09:40:51.832754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1793/2950] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:52.161132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:52.161778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:52.168814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.169298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.170067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.170505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.231953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:52.240402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:52.241955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:52.243109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bbf1c9e5-49b5-4292-bfe9-c22f6f9aa79b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085998 Aug 02 09:40:52.243667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1158/2951] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:52.252060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:52.252673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:52.259507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.259955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.260721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.260962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:52.261171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.261735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:52.267669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.268121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.268898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.269362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.323783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:52.333205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ee05b925-f8fe-4194-ba8d-f67b8efa9a7e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084917 Aug 02 09:40:52.333795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1794/2952] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:52.402791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:52.411337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b25080d0-a976-4f65-a4c4-7ff2065d2030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154548 Aug 02 09:40:52.411835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1159/2953] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:52.421054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:52.421711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:52.427731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.428193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.428949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.429419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.558341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:52.566324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c3ba0e12-d1e1-4fa3-95c6-a7bbd38bd192 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149107 Aug 02 09:40:52.566899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1795/2954] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:52 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:52.853592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:52.854249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:52.860333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.861097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:52.861863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:52.862632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.000379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.008299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0c67e2de-b205-4f62-a39f-7eb99668e4c6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158628 Aug 02 09:40:53.009143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1160/2955] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:53.267580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:53.268225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:53.274841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.275282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.276032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.276585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.337225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.345697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.347221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.348358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-750c884a-ec80-483b-9685-a6db3090bbfc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084743 Aug 02 09:40:53.349012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1796/2956] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:53.354040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:53.354787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:53.358208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:53.362158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.362615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.363380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.363847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.426704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.431675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:53.432490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:53.435220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-96dd98f4-c528-44ad-a9b1-627c20f638f6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085032 Aug 02 09:40:53.435971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1161/2957] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:53.439374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.439890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.440741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.441293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.568013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.576060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a6cc4cd2-a22e-41b8-8863-16cb3a0365c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148157 Aug 02 09:40:53.576632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1797/2958] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:53.587542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:53.588160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:53.594109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.594559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.595321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:53.595752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:53.723397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:53.731799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc85c616-c480-4cf8-8d38-0ccd78cd760d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148092 Aug 02 09:40:53.732388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1162/2959] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:53 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:54.031029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:54.031641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:54.037613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.038058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.038817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.039245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.170181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.178095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf03ffe4-0f5c-4de9-af17-93a0a6999382 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150936 Aug 02 09:40:54.178581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1798/2960] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:54.370643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:54.371288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:54.377769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.378228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.378996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.379442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.383487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:54.441414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.450435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.451969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.453142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad1e51e7-fe2d-4750-aa4f-853fe4335ce3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086540 Aug 02 09:40:54.453705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1163/2961] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:54.456077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:54.456694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:54.463355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.464544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.465343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.465784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.528272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.535809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-06363a94-b560-49fc-8af0-4d1740ebf2d6 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083838 Aug 02 09:40:54.536379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1799/2962] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:54.597186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:54.597839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:54.603880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.604422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.605302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.605745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.731441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.739385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8483c747-6daf-465a-8766-870f44b0881e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146057 Aug 02 09:40:54.739952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1164/2963] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:54.753360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:54.753982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:54.760239 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.761420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.762331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:54.762773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:54.891548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:54.904792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-25e165c1-20e1-47ef-8ed9-67283975a578 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154846 Aug 02 09:40:54.905908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1800/2964] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:55.198781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:55.199396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:55.205392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.205841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.206599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.207035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.338321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:55.346869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b3072d01-9fa6-45bd-820f-6bca0ac21403 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152069 Aug 02 09:40:55.347462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1165/2965] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:55.476332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:55.476971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:55.484150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.484592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.485391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.485828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.550526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:55.559617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:55.561026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:55.562213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa4e355e-9d44-4011-a724-edb8f56b23a0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089878 Aug 02 09:40:55.562780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1801/2966] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:55.622855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:55.623478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:55.629476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.629930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.630694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.631134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.691857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:55.700088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47032c3d-e634-4be4-8cf9-b32af580d176 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.147188 Aug 02 09:40:55.700648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1166/2967] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:55.762701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:55.763313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:55.769357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.769795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.770553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.770988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.899036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:55.903249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:40:55.908696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b1866ed-7377-402b-80d0-7bbbd77a59fa tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150750 Aug 02 09:40:55.909311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1802/2968] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:55.927781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:55.928390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:55.934592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.935070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:55.935837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:55.936297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.062907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:56.070743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e2fd428-f974-47f7-ada9-d6428c514fb0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.146911 Aug 02 09:40:56.071309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1167/2969] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:55 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:56.368825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:56.369505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:56.376447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.376902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.377701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.378145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.507431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:56.515752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1974e9a7-0e7e-4ab1-af67-6b5b43608faa tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150860 Aug 02 09:40:56.516334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1803/2970] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:56.584705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:56.585348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:56.591821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.592271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.593031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.593492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.658487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:56.667381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:56.669177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:56.670334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-81433a4f-88b6-4a2a-871a-1a6bfc81e4f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089540 Aug 02 09:40:56.670895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1168/2971] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:56.720656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:56.721308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:56.727320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.727773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.728535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.729545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.794282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:56.801904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-91bc3218-3897-4abf-a056-1b08108ae5ff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085208 Aug 02 09:40:56.802476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1804/2972] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:56.930074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:56.930686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:56.937099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.937583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:56.938349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:56.938789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.065925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.074078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5de4e49e-c318-4ab4-b810-97f37d0dce23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147815 Aug 02 09:40:57.074642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1169/2973] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:57.092304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:57.092926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:57.099001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.099447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.100210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.100650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.230366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.238309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa1400b6-a6f8-45df-b237-7b0d92f786b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150463 Aug 02 09:40:57.238880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1805/2974] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:57 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:57.536672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:57.537307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:57.543491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.543948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.544719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.545197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.673382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.681185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-be4c2d46-f116-4782-a954-3e6a53ddd14f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148333 Aug 02 09:40:57.681754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1170/2975] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:57.693532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:57.694148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:57.701215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.701671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.702435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.702878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.764767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.773266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.774771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.775969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9a7ab277-c290-47a1-8c86-cf8dfc63ed9d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086337 Aug 02 09:40:57.777034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1806/2976] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:40:57.822324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:57.823979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:57.829938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.830386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.831143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:57.831581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:57.892954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:57.900390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-61bca48e-4516-4c14-9785-3dfa42b60e4f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082045 Aug 02 09:40:57.901255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1171/2977] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:58.094894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:58.095431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:58.101600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.102046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.102798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.103229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.260298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:58.261066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:58.267398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.267860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.268645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.269086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.404619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.412693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-719a89cb-1add-4dd0-a1e8-e703a9717244 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156579 Aug 02 09:40:58.413303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1172/2978] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:58 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:58.454196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.462150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-350d937a-4a3e-4088-b502-5b9a3618ec2e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.371229 Aug 02 09:40:58.462730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1807/2979] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:58.703177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:58.703795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:58.710247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.710723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.711482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.711919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.799209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:58.799830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:58.806598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.807054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.808016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.808467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.848355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.860913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b4275d36-f15e-41b1-b78e-eab360158596 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.161542 Aug 02 09:40:58.861806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1173/2980] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:58.872707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.881287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.882794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.884200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bbf1ac92-63c7-47f6-8352-d0bd6e525de5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088659 Aug 02 09:40:58.884768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1808/2981] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:40:58.922098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:58.922718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:58.928789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.929270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.930032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:58.930468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:58.991941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:58.999731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66f13c4d-3d2b-4a4b-886f-36d1865e0479 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081670 Aug 02 09:40:59.000305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1174/2982] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:59.434741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:59.435357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:59.441435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.441884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.442645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.443083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.483137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:59.483757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:59.489707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.490158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.490925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.491359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.572914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:59.581628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c2aafa7d-d5c4-404c-949c-e60917a4a983 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151367 Aug 02 09:40:59.582204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1809/2983] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:59 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:40:59.620413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:59.628363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fae1beeb-28e1-49b5-b1cb-a5a6518a387a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149187 Aug 02 09:40:59.628930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1175/2984] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:40:59.881913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:59.882561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:59.889858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.890318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.891097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.891527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.907579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:40:59.908192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:40:59.914862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.915532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.916477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:40:59.916922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:40:59.983340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:59.991854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:59.993430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:40:59.994664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87c5f762-69f2-4a32-9ef1-865bafc1569c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091110 Aug 02 09:40:59.995237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1176/2985] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:40:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:00.019790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:00.020411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:00.026902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:00.028668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:00.029206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:00.029929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:00.030373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:00.035066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8cadd4a8-f5b1-4315-8606-c10198070da4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157048 Aug 02 09:41:00.035642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1810/2986] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:40:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:00.093070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:00.100558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2fdcc854-d3f2-43a0-ad61-e6936be18bb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084600 Aug 02 09:41:00.101139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1177/2987] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:00.602991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:00.603614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:00.610436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:00.610888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:00.611660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:00.612100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:00.649736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:00.650353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:00.656770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:00.657264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:00.658049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:00.658495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:00.742648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:00.751220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b7aed11-7430-40a8-8e30-0c1d6b674e8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152138 Aug 02 09:41:00.751813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1811/2988] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:00 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:00.788140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:00.796574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ef9902b-d6d7-470f-8938-3ca1215974c8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150841 Aug 02 09:41:00.797182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1178/2989] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:01.019317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:01.019952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:01.027048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.027496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.028247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.028679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.057368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:01.058005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:01.064012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.064467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.065273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.065719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.090419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.099085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.100616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.101814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd48153a-19dc-4b85-b710-6ef2540dcc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086470 Aug 02 09:41:01.102390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1812/2990] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:01.122548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:01.123196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:01.129289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.129743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.130511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.130947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.196223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.200499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.203882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:01.204233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-67e469f2-f1de-48db-966e-1a79e4442a14 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086176 Aug 02 09:41:01.204813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1813/2991] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:01.209313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-480e6290-a864-4e39-8da4-c7701c1387bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155992 Aug 02 09:41:01.209875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1179/2992] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:01.772143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:01.772762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:01.779468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.779921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.780693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.781174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.818421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:01.819063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:01.826084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.827016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.827842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:01.828473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:01.911542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.923051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-50ac985b-9b1b-4a65-b671-e1bf73f99c22 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154752 Aug 02 09:41:01.923648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1814/2993] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:01 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:01.962084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:01.970601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b066ca8f-689e-44a0-a18a-2a976a4e1dad tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156372 Aug 02 09:41:01.971167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1180/2994] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:02.125729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:02.126280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:02.132869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.133509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.134565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.135007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.199228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:02.207597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:02.209133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:02.210315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4297f3fd-fb36-41a4-8c17-9791f492e27d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088576 Aug 02 09:41:02.210888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1815/2995] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:02.225828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:02.226523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:02.231494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:02.232185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:02.232632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.233087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.233887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.234329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.238070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.238528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.239288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.239725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.296311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:02.303935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fe461c69-16d3-40c7-a250-a2532662dc67 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081880 Aug 02 09:41:02.304513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1181/2996] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:02.370422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:02.378415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8834d573-4a08-4d2a-814f-07adbf0306ee tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150710 Aug 02 09:41:02.378927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1816/2997] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:02.943946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:02.944498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:02.951129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.951572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.952324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:02.952755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:02.993366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:02.994014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:03.002717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.003182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.004016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.004457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.089781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.097951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2e198c9b-93b5-4fc4-a2ef-67fcb5bfeb36 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157900 Aug 02 09:41:03.098529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1182/2998] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:02 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:03.141062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.149071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-de00576c-5f40-4fc1-b788-2593f0524ed2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159642 Aug 02 09:41:03.149665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1817/2999] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:03.234127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:03.234694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:03.240602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.241058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.241854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.242303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.303105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.311602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.313134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.314296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73db9da5-3667-4ceb-a734-83267fe9b8d1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084164 Aug 02 09:41:03.314857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1183/3000] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:03.323934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:03.324663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:03.330812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.331266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.332031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.332470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.394659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.399698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:03.400319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:03.402993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd70b400-6785-479e-b134-d861b0f23973 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082976 Aug 02 09:41:03.403572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1818/3001] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:03.407041 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.407491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.408253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:03.408690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:03.534581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:03.542719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1f815156-8dba-4010-8bb5-256e74ab70e0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146827 Aug 02 09:41:03.543289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1184/3002] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:04.120208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:04.120932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:04.127103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.127556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.128321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.128761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.148112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:04.171351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:04.171915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:04.178413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.178864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.179638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.180079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.264820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.273037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1dab16fc-078a-4bd4-a314-d876136e8d20 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157275 Aug 02 09:41:04.273658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1819/3003] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:04 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:04.313011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.320992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef0fbf03-f458-4724-840e-1ee4551850bd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154083 Aug 02 09:41:04.321582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1185/3004] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:04.337408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:04.338786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:04.344984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.345486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.346245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.346687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.408097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.416378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.418166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.419327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a7d8ab0e-153a-4930-b292-1f082a09fb3d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086291 Aug 02 09:41:04.420075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1820/3005] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:04.423699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:04.424245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:04.430251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.430714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.431477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.432010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.493622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.501069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9fdff389-a358-4ad2-a3ea-1c41cd92e199 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081511 Aug 02 09:41:04.501653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1186/3006] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:04.563899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:04.564523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:04.567511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:04.571413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.571871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.573320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:04.573942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:04.702709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:04.710525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bcf197b0-c58d-4856-b64b-040802622357 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150582 Aug 02 09:41:04.711097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1821/3007] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:05.295655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:05.296277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:05.302745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.303195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.303959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.304397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.343134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:05.343844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:05.350726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.351177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.351987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.352431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.434582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.442513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-78802f68-65df-40a0-8ed8-c737b72399b7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151417 Aug 02 09:41:05.443109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1187/3008] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:05 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:05.447691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:05.448327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:05.454511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.454965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.456190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.456190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.489887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.498818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-358666cd-a1b0-48b7-9706-18df19014736 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159570 Aug 02 09:41:05.499418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1822/3009] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:05.521917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.522539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:05.523146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:05.529704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.530174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.530913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.531101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.532425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.532612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.533859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bfd9cc4d-5607-4eb9-bd8d-108ed0dbfbee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089857 Aug 02 09:41:05.534423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1188/3010] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:05.593541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.600939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b17f1cb-f191-4571-8dad-a43939dee1dc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082220 Aug 02 09:41:05.601547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1823/3011] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:05.731771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:05.732416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:05.738434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.738884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.739650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:05.740091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:05.868529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:05.877332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f81d5ea6-df21-468e-9b85-9e64e2b7fe32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149389 Aug 02 09:41:05.877905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1189/3012] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:06.465761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:06.466374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:06.472900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.473404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.474253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.474692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.519713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:06.520329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:06.526935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.527384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.528157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.528600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.607645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:06.616266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9feece96-4ade-46a3-8a67-66d96f1a96d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154498 Aug 02 09:41:06.618211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1824/3013] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:06 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:06.623383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:06.624124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:06.630093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.630552 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.631325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.631760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.668546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:06.676833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9417fd53-8656-4ab4-bd9c-fcee9f06df8c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160898 Aug 02 09:41:06.677483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1190/3014] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:06.682618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:06.683495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:06.696273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.696446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.698147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.698777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.699624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:06.710041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:06.711985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:06.713329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f49534b3-37e6-441a-8860-76a7372b8913 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.095417 Aug 02 09:41:06.714680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1825/3015] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:06.764144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:06.771745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7b59901a-8136-4475-8a7e-95da328c6373 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.093308 Aug 02 09:41:06.772304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1191/3016] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:06.898569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:06.899189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:06.905914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.906367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:06.907141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:06.907580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.036626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.044998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-97cd181a-aa42-4ec0-8deb-9fe1ccaf9bdd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150326 Aug 02 09:41:07.045604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1826/3017] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:07.638732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:07.639273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:07.646021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.646477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.647241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.647684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.700250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:07.701065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:07.707638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.708154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.708975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.709440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.780485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.788775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-794b0dfb-dd83-4df3-9649-ad11d38221bf tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154138 Aug 02 09:41:07.789211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1192/3018] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:07 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:07.794406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:07.795049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:07.800996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.801952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.802346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.802794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.843885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.851992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6867804f-28bb-4016-bf1b-69c0e67b8c04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155648 Aug 02 09:41:07.852582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1827/3019] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:07.858266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:07.858880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:07.864905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.865360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.866131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:07.866568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:07.868183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.876815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.878386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.879529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b42ff7db-53fb-4759-a29a-eec535a092b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089395 Aug 02 09:41:07.880085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1193/3020] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:07.929561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:07.937301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4bd3bb60-1b19-4686-8c05-f1126e56f83a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083188 Aug 02 09:41:07.937880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1828/3021] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:08.067010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:08.067627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:08.074435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:08.074890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:08.075660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:08.076103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:08.205061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:08.213017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e22c34ac-e0b6-41e8-8226-457a951b9502 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149872 Aug 02 09:41:08.214137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1194/3022] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:08.811325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:08.811943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:08.818907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:08.819348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:08.820143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:08.820568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:08.876776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:08.877512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:08.884978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:08.886123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:08.886971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:08.887419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:08.983111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:08.993817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-10dfa0d1-ffa6-4f27-b1f7-ba8ff9108dc3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.186266 Aug 02 09:41:08.995403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1829/3023] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:08 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:09.001304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:09.001991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:09.014075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:09.014511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:09.015296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:09.015737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:09.037236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:09.047279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-914fa76f-943d-4e30-acd5-861410e8920e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.175729 Aug 02 09:41:09.048347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1195/3024] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:09.052664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:09.053297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:09.060263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:09.060867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:09.061673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:09.062106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:09.083448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:09.106217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:09.118083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:09.120434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:09.122311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ea430556-2799-45e9-a7cd-cb9887989190 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.125813 Aug 02 09:41:09.123624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1830/3025] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:09.149624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:09.159245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e5c77471-f6f9-43bc-8afa-5a082a654ef2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.109204 Aug 02 09:41:09.159245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1196/3026] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:09.234902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:09.235428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:09.242230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:09.242678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:09.243444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:09.243877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:09.405222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:09.417985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e7f9ac78-d68c-46c5-964a-36db97ac04e8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.187077 Aug 02 09:41:09.418575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1831/3027] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:10.016626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:10.017271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:10.023763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.024210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.024967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.025867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.069351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:10.069905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:10.077068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.077550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.078329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.078768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.217631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.226055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-475f14af-469b-43b6-80b3-32e6fd01c21a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160543 Aug 02 09:41:10.226760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1832/3028] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:10.231539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:10.232249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:10.238734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.239315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.240173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.240683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.309222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.317820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.319332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.320508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c80b197-619d-462d-940a-67a4b80f422c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092721 Aug 02 09:41:10.321181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1833/3029] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:10.326439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:10.327058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:10.332892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.333399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.334161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.334602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.392245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.398532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.400479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3850741a-87fd-4794-b509-333cc0e277df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.387678 Aug 02 09:41:10.401255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1197/3030] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:10 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:10.406545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a3f69981-a79c-4132-9660-43e4e52dbe76 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083654 Aug 02 09:41:10.407110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1834/3031] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:10.418975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:41:10.419282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:41:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:41:10.439449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:10.440059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:10.446167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.446611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.447830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:10.448017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:10.574477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:10.582341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9b00c49c-ce65-47ad-b269-e5595b054806 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146543 Aug 02 09:41:10.582908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1198/3032] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:11.247890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:11.248507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:11.255073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.255526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.256293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.256734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.344532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:11.345172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:11.351825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.352308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.353330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.354363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.386844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.394952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-af904ef7-f157-4c31-8489-15ed2c752d5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151059 Aug 02 09:41:11.395544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1835/3033] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:11.419930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.421611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:11.422290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:11.428659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.429094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.429770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.429926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.430311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.431268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.432947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ebf699cb-7a9b-4254-9838-8872fd7e2150 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092802 Aug 02 09:41:11.433527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1199/3034] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:11.436251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:11.438219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:11.438824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:11.444809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.445365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.446738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.446738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.507700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.515765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-23364cad-30a4-44c6-8af3-53ad9c380bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081270 Aug 02 09:41:11.516548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1200/3035] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:11.564827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.573191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-109dd0d8-461c-4c83-b0cd-8054ca5a8b1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155643 Aug 02 09:41:11.573964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1836/3036] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:11 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:11.603259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:11.603888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:11.610403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.610856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.611621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:11.612091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:11.738963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:11.746931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-80c7b16f-8d36-483b-8a59-4af67776c3c0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147507 Aug 02 09:41:11.747496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1201/3037] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:12.417091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:12.417734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:12.424475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.424927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.425741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.426180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.458068 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:12.458776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:12.465506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.466029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.466863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.467299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.534370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.543446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.545039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.546216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c969f0f4-a700-4a81-9708-6a190e6a9072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092077 Aug 02 09:41:12.546775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1202/3038] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:12.551120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:12.551708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:12.558256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.558701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.559463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.559893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.560445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.568880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-257d6417-5db0-4550-835d-7596b7c90af0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155683 Aug 02 09:41:12.569491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1837/3039] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:12.594230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:12.594837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:12.600838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.601315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.602076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.602505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.621305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.628788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dd818820-d1de-4acb-bc3b-2e7bbfb18ccc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081049 Aug 02 09:41:12.629373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1203/3040] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:12.730805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.739080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3ae8a3e5-e197-4c9b-a12b-91446686c0cb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148542 Aug 02 09:41:12.739687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1838/3041] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:12 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:12.767712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:12.768368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:12.774386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.774843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.775664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:12.776110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:12.903001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:12.911232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e62fad15-f1b9-46d2-8872-8aa1cbd60c61 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147346 Aug 02 09:41:12.911829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1204/3042] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:13.569909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:13.570528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:13.577652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.578107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.578875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.579315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.590614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:13.591227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:13.597746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.598190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.598947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.599380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.644736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:13.654108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:13.655628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:13.656785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-24e958ac-11f0-47b6-966d-62ff39b594f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090840 Aug 02 09:41:13.657377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1839/3043] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:13.663476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:13.664172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:13.670295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.670829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.671665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.672106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.733964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:13.734145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:13.741462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9cb8b00c-9a83-4d67-ba90-c9ad1fb4dbf3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081457 Aug 02 09:41:13.742067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1840/3044] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:13.742204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d7a5d54-0871-4a8e-a654-7f630a7649a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155940 Aug 02 09:41:13.742669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1205/3045] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:13.761806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:13.762418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:13.768639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.769091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.769890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.770327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.902397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:13.910386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-89e91d43-f995-4936-82b0-392e582a383e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153406 Aug 02 09:41:13.911016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1841/3046] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:13 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:13.934806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:13.935426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:13.941471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.941926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:13.942695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:13.943131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.070755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:14.079010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e76f1170-e4bb-490e-9f6f-cbef1c134368 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148906 Aug 02 09:41:14.079579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1206/3047] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:14.679428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:14.680077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:14.686809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.687258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.688019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.688457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.749046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:14.757518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:14.759338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:14.760760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa911976-a3d0-4e2c-a6f6-784c308ab466 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085302 Aug 02 09:41:14.761358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1842/3048] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:14.773256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:14.773256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:14.773836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:14.773836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:14.774004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.774004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.774167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.774167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.774320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.774320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.774468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.774468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.847478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:14.855073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e3753193-ff35-4eff-883c-193bd250da0b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.094809 Aug 02 09:41:14.855707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1207/3049] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:14.918900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:14.927189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db05462e-d240-4a2b-813d-daf720450449 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.164857 Aug 02 09:41:14.927767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1843/3050] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:14.931894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:14.932454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:14.938492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.938926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:14.939690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:14.940127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.068866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:15.077270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f05b2a5d-fa90-4ef4-ae95-e2f8696a8b57 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149379 Aug 02 09:41:15.077837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1208/3051] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:14 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:15.099642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:15.100261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:15.106639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.107093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.107857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.108296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.239822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:15.248340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2803bbfd-23e1-4971-af2c-316e0b4945ef tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152533 Aug 02 09:41:15.248918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1844/3052] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:15.785223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:15.785834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:15.792894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.793375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.794126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.794557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.855445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:15.863791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:15.865307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:15.866439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed687b1a-f5a0-4e24-9e36-e2df020adc61 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085239 Aug 02 09:41:15.866985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1209/3053] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:15.876464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:15.877281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:15.884148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.885135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.885950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.886389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.948134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:15.948747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:15.954776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:15.954983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.955428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.956186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:15.956620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:15.963523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a34428f4-29d4-4af3-9405-5c366746b0e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.090267 Aug 02 09:41:15.964110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1845/3054] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:16.085162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:16.093707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c9021378-0f30-41c3-9f7b-22fb145fa92e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149447 Aug 02 09:41:16.094264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1210/3055] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:16.098396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:16.099019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:16.105733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.106183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.106986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.107423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.233879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:16.241804 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-41078ac2-8cd8-48f3-8c6c-3558eb840100 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147256 Aug 02 09:41:16.242405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1846/3056] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:16 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:16.270011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:16.270664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:16.273566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:16.278380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.278831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.279598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.280038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.411601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:16.420311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e0cab7e3-c185-4e83-9670-59043f7acf32 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154020 Aug 02 09:41:16.421050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1211/3057] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:16.890214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:16.890836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:16.897499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.897954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.898722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.899163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.963269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:16.971723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:16.973270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:16.974414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f4269ab3-80db-4cd0-b627-8affbaa01872 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088212 Aug 02 09:41:16.974977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1847/3058] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:16.983978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:16.984816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:16.991309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.991758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:16.992532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:16.992971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.056163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:17.064170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-576bcfc9-269f-4f09-acd8-302e5ccab8fa tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084105 Aug 02 09:41:17.064732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1212/3059] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:17.115135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:17.115777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:17.122412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:17.122866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.123632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:17.124071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.256031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:17.262983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:17.263596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:17.264456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a12d5e32-e95b-4300-bf32-7cfa23e0ed44 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153172 Aug 02 09:41:17.265167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1848/3060] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:17.269477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:17.269931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.270689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:17.271126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.275200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:17.398719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:17.407178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f9c3189-eb0d-4347-b71d-7edbb4c44722 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148266 Aug 02 09:41:17.407744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1213/3061] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:17 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:17.441030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:17.441674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:17.447659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:17.448111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.448872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:17.449352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:17.575977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:17.583961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ee22d08-bf19-4352-923e-035e9db20de3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146835 Aug 02 09:41:17.584536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1849/3062] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:17.998142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:17.998758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:18.005262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.005714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.006475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.006916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.071234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.080054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.081600 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.082747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b9d2de8a-d802-47c1-b87d-1154dbd53197 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088715 Aug 02 09:41:18.083311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1214/3063] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:18.085683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:18.086308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:18.093557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.094012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.094779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.095220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.158479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.166797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-49e3bc12-f418-4881-9684-fe03eadae487 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084743 Aug 02 09:41:18.167376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1850/3064] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:18.285568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:18.286177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:18.292131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.292573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.293360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.293795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.420854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.429148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8bd777bf-ac99-4382-8e65-51d39275e460 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147182 Aug 02 09:41:18.429390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:18.429726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1215/3065] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:18.430154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:18.437444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.437983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.438813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.439318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.572854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.580716 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b30c842-024f-45f3-8b24-3d8240091ae2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155377 Aug 02 09:41:18.581314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1851/3066] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:18 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:18.606515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:18.607135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:18.613394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.613853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.614627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:18.615096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:18.742464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:18.751184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fd0c747-196a-4c0a-b590-dae4816ebbcc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149312 Aug 02 09:41:18.751755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1216/3067] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:19.107226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:19.107834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:19.114520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.115067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.115736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.116171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.178012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.181500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:19.187737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:19.188305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.188549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:19.189483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.190639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-848518f9-b2fb-49f9-85af-c41356081133 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088110 Aug 02 09:41:19.191214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1852/3068] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:19.201550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.202046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.202840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.203287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.268809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.276843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-19eede44-f69f-4b6e-bcd6-7e9d75459908 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.093121 Aug 02 09:41:19.277468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1217/3069] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:19.452012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:19.452555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:19.458598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.459052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.459815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.460256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.586508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.595166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9a117b82-4e91-4f66-8390-69cdb396d552 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148062 Aug 02 09:41:19.595771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1853/3070] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:19.602176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:19.602878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:19.608820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.609314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.610081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.610522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.737466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.745527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9fd37d2c-2fdf-4e2b-bf49-d1b4ab15bfe3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147243 Aug 02 09:41:19.746132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1218/3071] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:19 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:19.773056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:19.773714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:19.780467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.780914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.781718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:19.782161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:19.917073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:19.925124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-abf5ae21-1acf-4102-8c26-b5df99a3ec42 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155879 Aug 02 09:41:19.925702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1854/3072] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:20.213551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:20.214201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:20.220610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.221061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.221937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.222378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.283235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:20.291761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:20.293324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:20.294481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e612298-4c9f-4676-98a8-f58ac871492c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085639 Aug 02 09:41:20.295060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1219/3073] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:20.297429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:20.298055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:20.304672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.305134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.305923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.306505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.367165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:20.374803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da2cf186-e637-45a6-87f4-a23fd7311e02 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081408 Aug 02 09:41:20.375370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1855/3074] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:20.616455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:20.617055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:20.623606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.624061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.624824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.625300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.754249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:20.763497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31f2b2cb-edf3-4585-82a6-de07ced7e849 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150905 Aug 02 09:41:20.764181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1220/3075] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:20.767150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:20.767773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:20.773873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.774322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.775799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.775799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.905753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:20.913939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81184ccc-9e45-4924-ae74-5c7a2f766e5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150929 Aug 02 09:41:20.914516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1856/3076] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:20 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:20.946257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:20.946868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:20.952955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.953476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:20.954241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:20.954687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.084656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:21.092841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-04727056-b324-4577-a403-a2e0db3a9dab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150444 Aug 02 09:41:21.093464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1221/3077] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:21.317007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:21.317648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:21.324233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.324682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.325841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.326280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.390735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:21.395733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:21.396340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:21.399359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:21.402163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:21.403326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-96db8771-c640-41c5-8dce-16aff4eb26cf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090237 Aug 02 09:41:21.403562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.403896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1857/3078] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:21.404051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.404891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.405485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.467043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:21.474620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8376b78d-e84c-4bb7-b359-663718354fbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082741 Aug 02 09:41:21.475192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1222/3079] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:21.784719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:21.785364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:21.791504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.791956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.792721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.793186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.924388 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:21.933339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd2f0259-6033-4856-8a3f-63555bd011c9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152472 Aug 02 09:41:21.933919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1858/3080] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:21.936176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:21.936792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:21.942749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.943193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:21.943948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:21.944437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.074800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:22.082666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f7c6f0e9-2861-42f9-ab17-54181a4f69ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150400 Aug 02 09:41:22.083221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1223/3081] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:21 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:22.114757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:22.115373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:22.122221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.122665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.123431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.123858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.250873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:22.259054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf8fd962-42c6-46e7-b16e-bea087f698f7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147990 Aug 02 09:41:22.259694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1859/3082] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:22.425827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:22.426409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:22.433308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.433754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.434520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.434967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.496133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:22.496573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:22.496743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:22.503256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.503698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.504458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.504886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.504991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:22.506512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:22.507654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-82786a58-0515-4928-8c3f-0f951c34ea5a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085814 Aug 02 09:41:22.508221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1224/3083] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:22.570490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:22.578549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54300d83-7f8e-4467-9031-7fd9be871beb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086552 Aug 02 09:41:22.579124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1860/3084] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:22.954400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:22.954975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:22.960958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.961442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:22.962220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:22.962830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.091632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.099584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4f83b157-6861-4352-907f-56483ae88579 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149194 Aug 02 09:41:23.100301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1225/3085] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:23.104313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:23.104926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:23.110909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.111349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.112099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.112526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.241414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.250793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa105b47-b1d3-4984-8ac4-de9fa0ab3b37 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150889 Aug 02 09:41:23.251392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1861/3086] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:23 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:23.279812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:23.280448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:23.286441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.286882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.287631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.288059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.418928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.426742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-acadb333-894d-4730-baef-276839b0d42e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150795 Aug 02 09:41:23.427325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1226/3087] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:23.531767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:23.532408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:23.538935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.539413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.540175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.540815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.599664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:23.600660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:23.602795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.606986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.607436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.608194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:23.608626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:23.611592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.613147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.614311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-12952a50-de48-4185-a9b6-79350c7b28e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086468 Aug 02 09:41:23.614886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1862/3088] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:23.669757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:23.676954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87cecea3-7548-4cb9-8e9b-8816e26e365e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081184 Aug 02 09:41:23.677538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1227/3089] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:24.122627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:24.123283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:24.129457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.129911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.130686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.131123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.263087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.272662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6a6cc7e2-5650-45a1-976f-7d7910af1f5a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155074 Aug 02 09:41:24.272970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:24.285174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1863/3090] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:24.285400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:24.285400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.285400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.285400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.285728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.448196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:24.448726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:24.454783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.455229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.455989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.456420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.477635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.487237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-66c76c1e-ead6-4f33-b3e6-036a1a64d97f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.218166 Aug 02 09:41:24.487822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1228/3091] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:24 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:24.588507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.596490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd59f26b-e10f-491a-a1ef-586dff8e7a9f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152510 Aug 02 09:41:24.597065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1864/3092] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:24.638472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:24.639078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:24.645419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.645865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.646646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.647078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.699504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:24.700073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:24.706185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.706637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.707416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:24.707853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:24.711105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.715321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:24.721160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.722705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.723857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d1224243-cc4d-45b5-8025-1784b7032c6c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090196 Aug 02 09:41:24.724417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1229/3093] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:24.769470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:24.777689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9bbd8ab4-5083-460e-ae83-e903d8f1b28d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083575 Aug 02 09:41:24.778272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1865/3094] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:25.296367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:25.296979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:25.303043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.303497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.304260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.304700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.430969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.439432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47342a59-8b0d-4c29-9594-f2f6e972e9dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147202 Aug 02 09:41:25.440001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1230/3095] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:25.509023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:25.509760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:25.515914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.516360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.517143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.517574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.617952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:25.619264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:25.625512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.625972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.626801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.627243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.649511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.658378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-75016bfe-3f7e-4eb4-91b4-278b4e604208 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153557 Aug 02 09:41:25.658962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1866/3096] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:25 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:25.746945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:25.747696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:25.753786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.754340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.755182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.755636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.757834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.766048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-047dbfde-69b8-4152-921f-de07303b042b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152015 Aug 02 09:41:25.766628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1231/3097] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:25.798563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:25.799334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:25.805405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.806241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.807186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:25.807698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:25.819344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.829241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.830755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.832072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6977d543-e234-4935-8d4a-d945122a3cda tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089191 Aug 02 09:41:25.838244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1867/3098] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:25.869759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:25.877211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f676e87d-b3cd-40e4-b5b8-3bf26f322021 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082547 Aug 02 09:41:25.877776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1232/3099] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:26.459996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:26.460613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:26.467889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.468343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.469142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.469585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.601350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:26.609380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c4cbc1ad-6cc5-4c09-95f3-9572dc0f9154 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153320 Aug 02 09:41:26.609966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1868/3100] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:26.679622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:26.680235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:26.687293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.687750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.688511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.688950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.787815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:26.788542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:26.795698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.796151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.796922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.797417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.816354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:26.821778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:26.829967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f1cab31a-dd70-47c5-9e89-71c6e9193155 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154131 Aug 02 09:41:26.830536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1233/3101] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:26 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:26.855974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:26.856601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:26.863050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.863505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.864280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.864722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.929321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:26.934545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:26.938172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:26.939690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:26.940845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b71c6e27-ebbf-435e-8da9-cce04e3acc1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089828 Aug 02 09:41:26.941523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1234/3102] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:26.942650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8a2ca3f4-8ffa-4b5d-9bf5-3d5e99a9f813 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158697 Aug 02 09:41:26.943406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1869/3103] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:26.945967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:26.947129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:26.953514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.953972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:26.954738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:26.955180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.015922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:27.023209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e31736ff-9820-4ca0-af66-1fe2285c00a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080744 Aug 02 09:41:27.023764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1235/3104] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:27.631165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:27.631819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:27.638691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:27.639176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.639944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:27.640384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.768379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:27.776371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9bf4470f-5737-4d13-a5c6-059dc7c6979b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149158 Aug 02 09:41:27.776947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1870/3105] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:27.850979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:27.851594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:27.858404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:27.858862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.859621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:27.860059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.964095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:27.964726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:27.971042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:27.973684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:27.974308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.975176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:27.975620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:27.996187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.004259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-57bc4ff7-af78-4b48-b849-eb32263162d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157119 Aug 02 09:41:28.009617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1236/3106] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:27 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:28.012776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:28.013428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:28.019567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:28.020110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:28.021213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:28.021741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:28.045533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.054086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.055612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.057355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-78d9c828-37ad-443b-af9b-ca9be7e79a0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.097384 Aug 02 09:41:28.057930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1871/3107] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:28.062582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:28.063201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:28.069260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:28.069720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:28.070500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:28.070940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:28.133191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.141710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-47299e71-d8aa-41eb-9816-c23e7ccdd869 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082799 Aug 02 09:41:28.142303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1872/3108] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:28.158615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.166804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-28b7e81a-7117-4872-ac94-21d4e4dda7ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160795 Aug 02 09:41:28.167363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1237/3109] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:28 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:28.797794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:28.798416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:28.804968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:28.805452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:28.806614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:28.807051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:28.937597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:28.945537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7fae096d-68ae-41ad-a681-a950ab5b5f1a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151791 Aug 02 09:41:28.946116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1873/3110] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:29.027766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:29.028379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:29.034599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.035053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.035814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.036254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.080425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:29.081021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:29.087133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.088123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.088889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.089354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.157203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:29.167165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:29.168673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:29.169863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-59ef73ec-601c-4a8c-a511-d9bd6908d903 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093312 Aug 02 09:41:29.170642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1874/3111] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:29.183429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:29.186712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:29.187324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:29.192711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-04d22a8c-3018-47d5-aebc-a5a5844cd34e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.169788 Aug 02 09:41:29.193455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.193908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.194755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.195194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.204950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1238/3112] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:29 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:29.210299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:29.210912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:29.217649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.218092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.218851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.219286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.264069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:29.271788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-235dde29-072c-43f8-8616-a82f41eb6e05 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.100249 Aug 02 09:41:29.272373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1875/3113] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:29.350856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:29.359562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e753f0fb-1c67-478b-8b7c-63df29b8c888 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153320 Aug 02 09:41:29.360144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1239/3114] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:29.966977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:29.967599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:29.974133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.974580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:29.975346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:29.975780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.104414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.112341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-564878da-4538-447e-8da4-f9637bb719f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149324 Aug 02 09:41:30.112905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1876/3115] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:30.192801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:30.193378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:30.200180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.200632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.201446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.201916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.215476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:30.216094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:30.222267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.222751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.223521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.223955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.264463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.272930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.275040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.276202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e41c9981-8ebe-4f7a-999a-0a43bc8cdfc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087373 Aug 02 09:41:30.276763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1240/3116] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:30.293641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:30.294260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:30.300155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.300638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.301429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.301872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.358625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.363277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.367002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a26d3f62-ace3-408e-8233-5a350ff156b0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155975 Aug 02 09:41:30.367592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1877/3117] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:30 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:30.371626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63d58c44-4e22-4a31-9a0b-5dd61f786ef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082473 Aug 02 09:41:30.372182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1241/3118] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:30.381383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:30.382070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:30.389213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.389645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.390405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:30.390840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:30.516598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:30.524566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-772469c5-654c-4be8-a4cd-8135f0b144d5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146902 Aug 02 09:41:30.525153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1878/3119] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:31.135501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:31.136114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:31.142334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.142790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.143583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.144024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.275826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.284831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6e5849fc-d821-4b63-847b-713f6cc24100 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154239 Aug 02 09:41:31.285450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1242/3120] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:31.299397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:31.300037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:31.307140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.307607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.308369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.308796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.372866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.389770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:31.390009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.390415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:31.391498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.392644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9d5ea5d2-a406-4df9-af17-006a599ff387 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.097221 Aug 02 09:41:31.393545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1879/3121] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:31.396608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.397140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.397930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.398047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:31.398370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.398546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:31.404764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.405243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.406002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.406431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.468332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.476068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6b81737b-d19c-48dd-999c-68e3f9223e8a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081490 Aug 02 09:41:31.476643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1880/3122] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:31.529506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.537528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2371ea4a-8fed-462d-8a15-a6a92bebaf97 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151770 Aug 02 09:41:31.538096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1243/3123] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:31 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:31.546233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:31.546858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:31.552864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.553431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.554219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:31.554684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:31.684391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:31.692295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d71dc790-4c81-41e7-a4ac-178719287333 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149997 Aug 02 09:41:31.692872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1881/3124] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:32.307292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:32.307916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:32.314414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.314858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.315608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.316038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.416426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:32.417010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:32.423519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.423965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.424728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.425194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.444761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.453037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f9ca578-cce0-454b-b9ae-ff020d0de122 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150256 Aug 02 09:41:32.453645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1244/3125] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:32.488993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.498057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.498756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:32.499368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:32.499545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.500690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0123b695-d096-45d4-b2d7-bb1bbb863ef5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089309 Aug 02 09:41:32.501280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1882/3126] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:32.505398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.505882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.506643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.507080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.557983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:32.558508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:32.564492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.564941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.565730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.566159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.571829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.579363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3f994277-b79b-46ee-baf3-9dc32764e7fb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084395 Aug 02 09:41:32.579936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1245/3127] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:32.697728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.705814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-329ed7fb-e5a6-44a1-a479-739c4dc0b7f5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151922 Aug 02 09:41:32.706386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1883/3128] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:32 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:32.715032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:32.715653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:32.721692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.722132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.722885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:32.723315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:32.742700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:32.853517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:32.861467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9122114a-1da9-44f3-981e-622f6e27cbed tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151178 Aug 02 09:41:32.862026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1246/3129] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:33.475790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:33.476395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:33.483014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.483456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.484204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.484636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.523672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:33.524373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:33.530866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.531313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.532077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.532509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.596090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:33.604252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:33.605786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:33.606943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6c8b4571-f124-41e5-8afe-b968e3c5b23b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087075 Aug 02 09:41:33.607502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1247/3130] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:33.611917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:33.612519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:33.618200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:33.619124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.619580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.620349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.620782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.627726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b001d9a-48a0-4916-a84f-d7a34d9d03d8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155783 Aug 02 09:41:33.628309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1884/3131] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:33.684667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:33.692060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0189a611-413c-491f-a175-dbd289fde120 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083609 Aug 02 09:41:33.692620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1248/3132] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:33.728064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:33.728641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:33.734640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.735081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.735828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.736257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.865559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:33.874073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d434e73c-2634-4507-806e-90e59cba004a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150416 Aug 02 09:41:33.874642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1885/3133] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:33 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:33.882783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:33.883403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:33.889627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.890075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:33.890836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:33.891269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.019637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:34.028099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-09ca775a-36eb-485d-9c4f-9ce7f12b4a63 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149196 Aug 02 09:41:34.028666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1249/3134] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:34.631367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:34.631975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:34.639341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.639790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.640557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.640998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.644931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:34.649367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:34.650572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:34.657301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.657583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.658333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.658773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.708326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:34.717078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:34.718679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:34.719813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-747ee660-16cd-4991-a857-c3463154080d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092477 Aug 02 09:41:34.720386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1886/3135] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:34.724822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:34.725881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:34.732402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.733007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.733825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.734268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.793586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:34.796060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:34.801552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fce818ec-6b25-4a86-aefb-cd1223b61458 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156219 Aug 02 09:41:34.802117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1250/3136] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:34.803646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dbe4f82b-97b3-45b9-9246-0aeb6b44cb0c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082298 Aug 02 09:41:34.804209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1887/3137] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:34.895334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:34.895905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:34.902028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.902477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:34.903237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:34.903672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.034784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.043320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7aa508e7-5a1c-45ad-ba77-b45b9938be23 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151910 Aug 02 09:41:35.043883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1251/3138] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:34 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:35.049962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:35.050587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:35.057540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.057995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.058762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.059201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.187515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.195444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-554a3c03-61e6-4de2-a6b7-e8f95d0c14d0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149367 Aug 02 09:41:35.196027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1888/3139] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:35.742847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:35.743696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:35.750192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.750632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.751383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.751812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.813826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.822879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.824327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:35.824794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.824970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:35.825709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e742a0c-317d-48c3-a08a-519989e5ebb4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086809 Aug 02 09:41:35.834153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1252/3140] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:35.834153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:35.834153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:35.834529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.834529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.834529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.834529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.839494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.839940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.840697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:35.841202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:35.902227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.909942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79c01eea-618d-4edf-86e5-eb225e5a330d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082359 Aug 02 09:41:35.910525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1253/3141] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:35.969680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:35.977754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c3979f4-5283-4dc3-bbbf-9d88812c3a94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157776 Aug 02 09:41:35.978296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1889/3142] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:36.065172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:36.065823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:36.072251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.072703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.073499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.073936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.214112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:36.217318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:36.217949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:36.222582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e33efb32-0867-42bd-8162-d49af3a34de3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161350 Aug 02 09:41:36.223268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1254/3143] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:36 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:36.224101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.224554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.225360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.225802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.354941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:36.363156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-709dc4f4-dab9-47ef-a312-1138dc793d31 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149703 Aug 02 09:41:36.363744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1890/3144] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:36.849328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:36.849940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:36.856954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.857445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.858207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.858643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.922717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:36.930467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:36.931340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:36.931945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:36.932850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:36.934028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc4da3ae-baf1-4e17-9ec5-9c3c596b207b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088750 Aug 02 09:41:36.934595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1255/3145] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:36.938774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.939228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.939998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:36.940439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:36.998852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:36.999397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:37.002602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:37.006725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.007179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.008063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.008404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.010925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa7db1ce-2ad2-4da2-ae75-eea9b8ecdb4e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084241 Aug 02 09:41:37.013419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1891/3146] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:37.148394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:37.157751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-991c3e8b-5248-42bb-b792-7fd71560b416 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.162724 Aug 02 09:41:37.158335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1256/3147] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:37.243759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:37.244370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:37.250483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.250882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.251640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.252080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.383304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:37.385903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:37.386557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:37.392140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-370dfe01-f75a-492e-87da-6c5ca3112db6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152288 Aug 02 09:41:37.392448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.392715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1892/3148] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:37 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:37.392904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.393712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.394154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.527348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:37.535209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc2a1ca7-d4d6-490c-bfdd-76b31f1717a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154236 Aug 02 09:41:37.535774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1257/3149] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:37.957015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:37.957715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:37.964761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.965233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:37.965995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:37.966431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.027643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.031807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:38.032432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:38.036250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.037808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.038867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.039011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dad611d0-b713-42d5-9c61-d2308f27431a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085870 Aug 02 09:41:38.039322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.039506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1893/3150] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:38.040686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.041148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.102715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.110209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d5d9e9fa-4f79-4b8c-bad6-8dd73e0ce7b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082199 Aug 02 09:41:38.110781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1258/3151] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:38.179581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:38.180128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:38.186223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.186671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.187430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.187864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.315219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.323759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c8b5512b-461f-4d66-a645-642fa7db10df tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148170 Aug 02 09:41:38.324328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1894/3152] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:38.413820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:38.414425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:38.420393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.420844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.421631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.422061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.548452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.558078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3815ccf1-abfa-4495-9e50-32f578b606d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147956 Aug 02 09:41:38.558275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:38.558799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1259/3153] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:38 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:38.558941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:38.565168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.565623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.566395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:38.566859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:38.698474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:38.708996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b894c4d6-c384-4a05-ab9d-57217393a252 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155382 Aug 02 09:41:38.709606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1895/3154] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:39.063248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:39.063882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:39.069914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.070355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.071696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.072134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.131027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:39.131889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:39.139193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.141222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.141686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.142896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.142896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.147882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.150194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.151364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a9b21401-6c73-4716-b4ee-d7f0f2cfd2ad tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092584 Aug 02 09:41:39.151933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1260/3155] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:39.210250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.217951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0353b66-ffce-44d8-98fb-f3986eec3093 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.091106 Aug 02 09:41:39.218524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1896/3156] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:39.345018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:39.345664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:39.348579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:39.352168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.353538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.354324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.354767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.484201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.492163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-58a5b3ef-8a84-4ad4-97ac-2b81e49fa711 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150959 Aug 02 09:41:39.492731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1261/3157] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:39.580828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:39.581477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:39.588051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.588500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.589293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.589732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.717123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.725165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e257f096-d6ef-4223-b271-edebc8d5d038 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148203 Aug 02 09:41:39.726131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1897/3158] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:39 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:39.731639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:39.732310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:39.738174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.738630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.739397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:39.739867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:39.871644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:39.879680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94c9057c-bf12-4ff4-8034-f70cc5859364 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152614 Aug 02 09:41:39.880244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1262/3159] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:40.174204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:40.174882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:40.181690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.182145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.182910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.183351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.239155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:40.239846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:40.246443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.246890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.247650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.247985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:40.248134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.252067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:40.256769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:40.258327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:40.259861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8afac00d-8e63-40a5-9cc4-463c55e229d3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089673 Aug 02 09:41:40.260431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1898/3160] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:40 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:40.310552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:40.318111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-11beb74b-63eb-4afb-8adb-9cc8c4b6f289 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082870 Aug 02 09:41:40.318667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1263/3161] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:40.514944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:40.515560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:40.521696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.522142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.522899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.523337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.654261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:40.662234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bbb03117-eb0e-4e2d-9b97-696ee2899381 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151220 Aug 02 09:41:40.662816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1899/3162] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:40.747122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:40.747737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:40.753649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.754097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.754854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.755287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.882328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:40.890618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9d911bdc-1d24-477f-bd56-f92fe516af08 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148033 Aug 02 09:41:40.891178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1264/3163] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:40 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:40.901067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:40.901812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:40.908115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.908567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:40.909368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:40.909809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.036939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:41.045524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02515134-e672-4163-8f2e-e551b13673d8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148818 Aug 02 09:41:41.046084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1900/3164] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:41.284080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:41.284861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:41.291187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.291635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.292395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.292832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.339809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:41.340437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:41.347053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.347522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.348309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.348754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.353785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:41.362126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:41.363649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:41.364803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1a4be7cf-5fa4-4acd-8a2f-3fa76728249b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086210 Aug 02 09:41:41.365418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1265/3165] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:41.415201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:41.422776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cae0269e-fde0-423e-af5c-e7b535347919 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087617 Aug 02 09:41:41.423347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1901/3166] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:41.684134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:41.684664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:41.690721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.691170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.691931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.692365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.822603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:41.830476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e599e82e-5226-4566-b0f8-86fa2e72a395 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151054 Aug 02 09:41:41.831035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1266/3167] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:41.911875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:41.912491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:41.919399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.919848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:41.920614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:41.921057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.048304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.051894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:42.058133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-335366dd-9994-4c55-8783-ec5c189e8ab0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150170 Aug 02 09:41:42.058706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1902/3168] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:41 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:42.065903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:42.066522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:42.072723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.073206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.073971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.074412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.202440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.210291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-597be791-ca63-4219-a397-cfe255e3cb8d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148224 Aug 02 09:41:42.210852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1267/3169] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:42.388334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:42.388972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:42.395570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.396018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.396782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.397257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.444025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:42.444669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:42.451251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.451685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.452454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.452894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.459885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.468929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.470480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.471631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ec3f6b8-8f8f-48be-a059-37b4d7117f57 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087517 Aug 02 09:41:42.472204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1903/3170] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:42.517984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.526237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-584a9148-4598-4803-9da9-ffba2e4488b3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086303 Aug 02 09:41:42.526910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1268/3171] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:42.851783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:42.852424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:42.858737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.859190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.859959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:42.860400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:42.989906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:42.998999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df6dce6d-a9b3-444d-81ae-89f9ce23f29b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151081 Aug 02 09:41:42.999584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1904/3172] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:43.079015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:43.079627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:43.085549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.086000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.086921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.087424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.214100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:43.221891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ee01db95-1646-42dd-a742-1e1968a0a2fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.146700 Aug 02 09:41:43.222476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1269/3173] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:43.231800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:43.232449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:43.238511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.238902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.239696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.240137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.367698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:43.376226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d00857a6-f1a2-4675-84fc-7c87e7677f47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148312 Aug 02 09:41:43.376795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1905/3174] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:43.495592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:43.496109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:43.510123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.510585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.511357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.511791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.547010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:43.547763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:43.554739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.555200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.557188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:43.557643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:43.574709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:43.583062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:43.584576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:43.585749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d8cefd5-a69b-46d0-9249-47c16a770360 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094871 Aug 02 09:41:43.586311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1270/3175] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:43.621262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:43.628800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40602800-9293-41c0-b7ae-8a052777dc51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085719 Aug 02 09:41:43.629412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1906/3176] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:44.020896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:44.021574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:44.028117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.028566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.029381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.029819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.160182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.168361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-638d23ca-6d3a-46fe-84a5-0df6a02dcacb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151319 Aug 02 09:41:44.168920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1271/3177] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:44.243026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:44.243686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:44.249789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.250243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.251012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.251452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.382477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.391019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-230eef97-aa78-467d-8887-9613af787fa2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151989 Aug 02 09:41:44.391595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1907/3178] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:44 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:44.397194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:44.397815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:44.404416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.404870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.405660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.406103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.534875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.543105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-602994d9-8fd2-426b-b2cf-2e7b1a0897a5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149873 Aug 02 09:41:44.543677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1272/3179] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:44.609202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:44.609819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:44.616635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.617215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.619218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.619655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.650160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:44.650777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:44.656802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.657296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.658072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:44.658514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:44.681861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.690324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.691823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.692971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4a44dbbb-dfea-41f4-8616-cc56ce0b5188 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088106 Aug 02 09:41:44.693563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1908/3180] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:44.722175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:44.729628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bb2afe2a-5db0-4e93-8c37-817c90d52e2c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083332 Aug 02 09:41:44.730196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1273/3181] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:45.189710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:45.190245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:45.196311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.196747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.197532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.197961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.329506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.338294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ba2d0d77-02bd-4d4c-a298-6cb71da3dfbb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152510 Aug 02 09:41:45.338876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1909/3182] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:45.415437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:45.416059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:45.422144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.422593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.423362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.423801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.555278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.563483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2f8652b8-b1eb-408c-b120-756ae7d75d2f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152414 Aug 02 09:41:45.563691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:45.564057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1274/3183] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:45.564298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:45.570201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.571207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.572601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.573041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.703104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.712032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2bd19f8e-d989-4ee7-b14e-7301cacfa938 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151438 Aug 02 09:41:45.712682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1910/3184] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:45.716806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:45.717526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:45.723522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.724097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.724925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.725458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.750628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:45.751274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:45.757634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.758090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.759932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:45.760375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:45.787741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.796573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.798224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.799524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-590239a6-d4da-426d-84c9-b613f093b403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086980 Aug 02 09:41:45.800176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1275/3185] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:45.823844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:45.831342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-76136e03-bd57-424b-9dde-edaab48ca32a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084691 Aug 02 09:41:45.831919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1911/3186] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:46.358867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:46.359540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:46.365551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.366005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.367145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.367593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.541383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.549428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-41baba2b-2d33-49c8-8b2d-125d20938f38 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.194380 Aug 02 09:41:46.550124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1276/3187] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:46.585908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:46.586527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:46.592621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.593074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.593881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.594324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.721744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.730113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9e7e93ac-f318-4af0-aee2-b6e2d0e0f8cc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148132 Aug 02 09:41:46.730694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1912/3188] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:46 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:46.733448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:46.734065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:46.740283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.740738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.741582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.742056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.823455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:46.823849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:46.830059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.830507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.831283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.831730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.878642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.887921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-09949bc2-4e30-4c7f-b09f-e2e9552cf944 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158421 Aug 02 09:41:46.888536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1277/3189] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:46.893207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:46.893971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:46.897439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.900951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.901516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.902295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:46.902728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:46.907297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.909005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.910189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-950f9ac1-aeed-4518-b1e0-30b3c1fd5fe4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091523 Aug 02 09:41:46.910759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1913/3190] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:46.964885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:46.972296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a8972dc6-6ec0-4040-aca4-d8185da9f6b5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082563 Aug 02 09:41:46.972848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1278/3191] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:47.572065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:47.572673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:47.578750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.579195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.579946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.580376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.707533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:47.716080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ec00d731-7d4e-4c53-ae5d-c1afd7427e1e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148287 Aug 02 09:41:47.716664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1914/3192] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:47.751612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:47.752235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:47.759621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.760073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.760835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.761316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.888287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:47.891729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:47.897340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d601bf38-b6ba-4144-b10a-3b0b07640d28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149518 Aug 02 09:41:47.897906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1279/3193] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:47 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:47.910130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:47.910849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:47.917196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.917648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.918404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.918836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.934482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:47.935118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:47.940976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.941458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:47.942219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:47.942656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:48.007045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:48.016356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:48.017908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:48.019067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c97de7a4-d195-4a6f-93fa-3d67afa13d88 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088750 Aug 02 09:41:48.019799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1280/3194] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:48.029708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:48.030456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:48.036457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:48.036906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:48.037700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:48.038131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:48.053298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:48.061741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-20875d27-3c03-464b-82e9-10b4f9c9dcdb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155544 Aug 02 09:41:48.062316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1915/3195] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:48.099028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:48.106707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d00bfc0b-d7c4-40dc-869b-387c77deffda tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080573 Aug 02 09:41:48.107271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1281/3196] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:48.737058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:48.737719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:48.745065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:48.745543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:48.746318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:48.746758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:48.876757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:48.885426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-20015bc7-64f9-409f-b2f8-88a64041e93a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152373 Aug 02 09:41:48.886011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1916/3197] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:48.919910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:48.921191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:48.927937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:48.928385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:48.929177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:48.929610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.042933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:49.043615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:49.049602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.050880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.051919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.052358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.061852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:49.069768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6150756b-8e19-4e79-9d48-803f9b214344 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153804 Aug 02 09:41:49.071344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1282/3198] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:48 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:49.086869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:49.088035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:49.094231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.094677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.095439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.095868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.115013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:49.123622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:49.125134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:49.126295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-395799fe-8dff-4cc9-a3c3-3576646f09d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088325 Aug 02 09:41:49.126867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1917/3199] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:49.132251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:49.132515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:49.142091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.142655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.143575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.144020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.208106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:49.216317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-75952cd8-0a38-4ba9-afb9-1bb8d1dfa2eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088481 Aug 02 09:41:49.216911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1918/3200] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:49 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:49.233662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:49.241776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-230b2170-f58b-4c47-a840-54bd1040bf5c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159335 Aug 02 09:41:49.242386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1283/3201] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:49.907072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:49.907681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:49.914418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.915583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.916357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:49.916932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:49.935058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:50.049987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.057994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7fa95cc9-43aa-41de-9636-a4255d8d57cf tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154801 Aug 02 09:41:50.058581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1919/3202] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:50.091685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:50.092303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:50.098792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.099243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.100004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.100446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.154774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:50.155395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:50.161603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.161991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.162765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.163209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.225696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.231880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.234398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.235911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.237065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fcb478b3-860d-4d5d-9724-fb98c6138cb7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086379 Aug 02 09:41:50.237663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1920/3203] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:50 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:50.238592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3633e960-dace-468b-be56-ac5ee4748e7a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150744 Aug 02 09:41:50.239316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1284/3204] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:50.246822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:50.247442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:50.250532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:50.254026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.254477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.255255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.255690 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.263974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:50.264625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:50.270592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.271046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.271808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:50.272250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:50.317997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.326122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c7cd9227-0a6c-4d02-835f-a1d1d24757d7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087488 Aug 02 09:41:50.326703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1921/3205] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:50.401497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:50.409304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-155341b0-e568-44a7-a5a2-563daa84ef47 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149155 Aug 02 09:41:50.409873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1285/3206] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:51.079843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:51.080464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:51.087521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.087976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.088744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.089213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.219662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.228586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3619c7c9-f0cf-4201-9f73-82c3c2e3104b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152645 Aug 02 09:41:51.229187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1922/3207] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:51.260115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:51.260720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:51.261188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:51.261810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:51.267270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.267718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.267836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.268182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.268471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.268946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.269062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.269421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.330915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.339865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.341419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.342580 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f5e2d4ac-fff5-4030-9456-6d3a0463ad1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085655 Aug 02 09:41:51.343149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1923/3208] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:51.347585 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:51.348201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:51.354987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.355432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.356202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.356638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.400804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.408795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b669a20f-b32a-4613-a7a1-c19cc9fda916 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152951 Aug 02 09:41:51.409414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1286/3209] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:51.419130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.426911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d872d8ab-b7d3-40bb-bd9e-590b797d52d1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082782 Aug 02 09:41:51.427488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1924/3210] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:51.430826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:51.431441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:51.437373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.437823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.438586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:51.439024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:51.566084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:51.574036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63e8f0d8-0a98-4a16-b89a-cf478c90de70 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147502 Aug 02 09:41:51.574609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1287/3211] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:52.251289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:52.251824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:52.259115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.259571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.260337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.260777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.365489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:52.366139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:52.372655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.373104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.373897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.374336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.391203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.400470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d1baaba6-ca61-463b-9984-520b4da08fa4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153121 Aug 02 09:41:52.401175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1925/3212] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:52.430216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:52.430832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:52.437271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.437390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.438114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.438549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.439485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.450519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.452030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.453253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-77a7dada-3127-4492-a1c7-900d5ae9fe10 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091607 Aug 02 09:41:52.453818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1288/3213] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:52.458287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:52.458895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:52.465516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.466022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.466785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.467251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.532381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.540097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2d49ec01-4353-43a9-a9b5-e8981cdb26cd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085301 Aug 02 09:41:52.540870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1289/3214] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:52.571841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.579977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4a8ab997-a338-4d1f-8f79-decf42b6a542 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153744 Aug 02 09:41:52.580569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1926/3215] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:52 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:52.595712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:52.596333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:52.602361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.602812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.603578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:52.604014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:52.730813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:52.738619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-889a54fb-4682-47d2-b115-8b19c34aa73a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146734 Aug 02 09:41:52.739199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1290/3216] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:53.421885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:53.422493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:53.429064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.429537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.430350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.430867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.483393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:53.484017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:53.490443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.490896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.491664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.492101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.561503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.563554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.569915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.571461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.571599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-64abf08c-8cb0-4f47-bab5-4e547cbd6e2b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153591 Aug 02 09:41:53.572177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1927/3217] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:53.572608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-433321e5-6bc6-4950-a019-b3109125f5c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093185 Aug 02 09:41:53.573169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1291/3218] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:53.576881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:53.577528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:53.583385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.583833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.584605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.585044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.601158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:53.602317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:53.608490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.608955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.609743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.610176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.651175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.658824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-237a69c0-c924-4813-a99d-a600ed523873 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085683 Aug 02 09:41:53.659763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1928/3219] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:53.748373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.756310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a92ec73f-def3-404d-b7f0-a63f50ab89c6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.158970 Aug 02 09:41:53.756885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1292/3220] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:53 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:53.760576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:53.761232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:53.767346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.767793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.768556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:53.768986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:53.897954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:53.907450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dc66cebd-cd86-425c-bf5c-9fc766b89fd4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151352 Aug 02 09:41:53.908072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1929/3221] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:54.593305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:54.593932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:54.595261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:54.595879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:54.600459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.600919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.602498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.602945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.603047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.603508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.604279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.604713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.667028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:54.675697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:54.677229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:54.678389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9300973-7ea6-45f0-907a-c7d0a86cee7e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087018 Aug 02 09:41:54.678962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1930/3222] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:54.684305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:54.684911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:54.690979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.691434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.692200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.692637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.736392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:54.744715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-279a7abb-9874-4785-86aa-1edd2ffc0e63 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155341 Aug 02 09:41:54.745363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1293/3223] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:54.756246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:54.764183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-362b70a3-752e-4153-b532-04c0dd9e90f2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084253 Aug 02 09:41:54.764731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1931/3224] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:54.778502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:54.779119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:54.785182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.785635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.786402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.786843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.917794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:54.926248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d08cb62b-49be-414a-8866-385afb567712 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151690 Aug 02 09:41:54.926826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1294/3225] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:54.928111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:54.928723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:54.934732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.935175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:54.935925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:54.936354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.065312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:55.073386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4b3100c7-f204-49b6-9378-38a538c44899 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149086 Aug 02 09:41:55.073952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1932/3226] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:55.702435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:55.702963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:55.709430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.709883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.710643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.711111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.765512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:55.766128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:55.772711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.773222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.773796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:55.774482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.775282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.787832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:55.789480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:55.790640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d925a012-c841-405d-b707-0eed75735510 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092250 Aug 02 09:41:55.791203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1295/3227] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:55.795693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:55.796792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:55.802239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.802691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.803613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.804069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.823144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:55.868491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:55.875805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3a7dc7fd-74e0-46c1-be9d-b3ca0586e55f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083620 Aug 02 09:41:55.876570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1296/3228] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:55.912785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:55.921407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dbbe7c97-3ff4-4d97-967e-48717906442b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159866 Aug 02 09:41:55.922029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1933/3229] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:55.947466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:55.948075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:55.954108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.954492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:55.955243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:55.955672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.083241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:56.091468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95eb0c4f-5eb8-43e7-b42f-9dfbb781de82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148037 Aug 02 09:41:56.092031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1297/3230] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:55 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:56.095145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:56.095758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:56.102315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.102762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.103521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.103951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.229946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:56.238379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-16ec5f3e-ba0d-4820-90da-d045f8d9e5e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146857 Aug 02 09:41:56.240105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1934/3231] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:56.814585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:56.815198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:56.822735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.823190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.823944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.824380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.887739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:56.896397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:56.897429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:56.897932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:56.898141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:56.900315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e4802d5-6db3-449b-9cf9-1640577d9f09 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089719 Aug 02 09:41:56.900871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1298/3232] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:56.905509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.905965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.906749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.907188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.943233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:56.943846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:56.950658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.951112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.951878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:56.952311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:56.969854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:56.977419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4045b8c0-edb3-4876-b66d-6b3e5ad6f9cc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083889 Aug 02 09:41:56.977996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1935/3233] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:57.080818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:57.088770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a79be61-f91d-439e-8122-95b26292a45f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149348 Aug 02 09:41:57.089362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1299/3234] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:57.112573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:57.113219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:57.119688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:57.120137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:57.120888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:57.121374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:57.125274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:41:57.251940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:57.261493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2fdbd7f3-1efb-406d-88b6-3f78ace31a4d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152607 Aug 02 09:41:57.262072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1936/3235] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:57 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:57.262327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:57.262953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:57.268938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:57.269424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:57.270191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:57.270630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:57.402238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:57.410142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-60b0b0b9-1b9a-4971-b613-0019ea61a8ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152476 Aug 02 09:41:57.410709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1300/3236] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:57.923638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:57.924334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:57.931433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:57.931972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:57.932758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:57.933226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:57.995532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:57.998799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:57.999423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:58.004215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:58.005769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:58.006005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.006459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.006919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4e970483-8789-4636-ab2f-9d5f89796d60 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087370 Aug 02 09:41:58.007231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.007494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1937/3237] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:41:58.008834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.071355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:58.078802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1a0f12f5-0361-472a-8e94-5ae1b5b05632 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083917 Aug 02 09:41:58.079377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1301/3238] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:58.108907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:58.109646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:58.115719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.116170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.116935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.117940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.243902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:58.251874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33fe262a-6fa6-4d0e-87cb-6a0b17af0030 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.146888 Aug 02 09:41:58.252450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1938/3239] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:58.282622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:58.283229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:58.289914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.290432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.291207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.291651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.416714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:58.424624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40a9fadd-0f75-4de6-b0f8-ac85323acd65 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.145785 Aug 02 09:41:58.425217 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1302/3240] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:58 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:58.432386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:58.433005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:58.438951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.439399 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.440160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:58.440597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:58.571287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:58.579152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-86e6a700-36ec-4ae4-91d6-2c02b47eace5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151338 Aug 02 09:41:58.579727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1939/3241] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:59.030281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:59.030889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:59.037295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.037740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.038497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.039011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.099487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:59.100180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:59.103422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.106408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.106859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.107621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.108052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.111785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.113341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.114493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1f7aa7f0-f607-44d4-b36f-5671bb6efda9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088112 Aug 02 09:41:59.115062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1303/3242] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:41:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:41:59.170336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.177986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-75e78915-8827-488e-9585-d31c98e76596 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082274 Aug 02 09:41:59.178499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1940/3243] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:41:59.275190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:59.275811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:59.281758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.282234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.282996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.283431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.409677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.417461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-42b728bd-a9a9-4cda-a15d-9761491c0d00 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147489 Aug 02 09:41:59.418023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1304/3244] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:59.446951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:59.447529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:59.454238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.454699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.455469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.455907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.581833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.589782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c06b8538-a9ea-4b25-b5e2-7f9cf94d9871 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147427 Aug 02 09:41:59.590348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1941/3245] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:59 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:41:59.600817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:41:59.601521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:41:59.607638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.608091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.608855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:41:59.609331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:41:59.737667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:41:59.746108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-39903269-6043-4aa0-aaec-98950340a95c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149138 Aug 02 09:41:59.746674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1305/3246] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:41:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:00.137631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:00.138248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:00.144340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.144793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.145588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.146033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.198659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:00.199463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:00.206162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.206695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.207595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.208085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.209895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.218988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.220510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.221706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ddbf8568-af13-4ee4-b510-b1a57a317e58 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088398 Aug 02 09:42:00.222468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1942/3247] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:00 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:00.274093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.283890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-748700d2-45e9-4b96-9e35-bb1b9c29509e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089158 Aug 02 09:42:00.284451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1306/3248] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:00.439418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:00.439963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:00.446909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.447362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.448130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.448570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.575001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.582982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8d4c1196-cceb-47fe-91c9-08860c077223 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147579 Aug 02 09:42:00.583557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1943/3249] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:00.610556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:00.611168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:00.617375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.617817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.618564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.618993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.747166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.755060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5868c412-b91d-4167-b472-096876e67702 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148290 Aug 02 09:42:00.755628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1307/3250] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:00 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:00.767560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:00.768174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:00.774405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.774860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.775635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:00.776074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:00.905294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:00.913382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5a35e931-41a1-49f5-9227-7c5042b26fa7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149682 Aug 02 09:42:00.913986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1944/3251] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:01.245706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:01.246322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:01.252202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.252658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.253541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.253981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.305187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:01.305875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:01.314557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.315110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.315955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.316508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.319546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:01.328175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:01.329704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:01.330847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f6befc05-963f-483d-b5f8-24bab1435cac tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089771 Aug 02 09:42:01.331620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1308/3252] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:01.381467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:01.389251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ee84d0d1-33d4-4238-9799-c5c93708a206 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088613 Aug 02 09:42:01.389821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1945/3253] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:01.606527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:01.607149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:01.613186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.613638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.614406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.614841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.755147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:01.763566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-35f728ab-62a0-43e5-99aa-de94e9ae8bb7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160862 Aug 02 09:42:01.764129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1309/3254] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:01.776321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:01.776934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:01.782960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.783403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.784160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.784592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.912707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:01.920892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e8a2702-9e23-4a37-aff7-4c13f7dae56d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149020 Aug 02 09:42:01.921510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1946/3255] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:01 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:01.934759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:01.935373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:01.941268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.941717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:01.942471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:01.942904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.068509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:02.076815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a3aecaa4-d5ec-49da-b264-20de3cb1db5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.145892 Aug 02 09:42:02.077471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1310/3256] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:02.353686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:02.354302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:02.360902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.361397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.362165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.362605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.410314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:02.410906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:02.413854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:02.418915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.419342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.420349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.420789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.425016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:02.434209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:02.435730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:02.436892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-91146db6-1b5d-4bae-add4-4a38bd83f9fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087443 Aug 02 09:42:02.437734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1947/3257] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:02.483495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:02.490936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b089ae44-7d5a-46fa-8703-b43a3d1bc961 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084449 Aug 02 09:42:02.491496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1311/3258] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:02.786113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:02.786734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:02.793516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.793971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.794735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.795175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.926472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:02.935170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-55335eef-1e09-4e96-8d5f-f6d00b54a5b0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152953 Aug 02 09:42:02.935747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1948/3259] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:02.941470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:02.942094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:02.948689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.949178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:02.949943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:02.950380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.098270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:03.099065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:03.106249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.106705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.107490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.107930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.245513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:03.253744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-80c6c43b-4367-4910-8910-2b0296e5af88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159602 Aug 02 09:42:03.254454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1949/3260] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:03.321135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:03.329270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-247083fa-73ad-4051-be43-49689dff15fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.391683 Aug 02 09:42:03.329839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1312/3261] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:02 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:03.461537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:03.462153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:03.468631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.469079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.469870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.470306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.512209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:03.512901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:03.519056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.519564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.520328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.520761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.525197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:03.532182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:03.541999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:03.543694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:03.544863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-379539f8-7f3c-40d8-ab55-525a331005f9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087921 Aug 02 09:42:03.545469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1950/3262] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:03.584108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:03.591968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e73922c0-8e19-47b9-ba54-5ca715b9d0f0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084045 Aug 02 09:42:03.592540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1313/3263] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:03.958534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:03.959145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:03.965694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.966140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:03.966899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:03.967332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.276516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:04.277248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:04.284123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.284583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.285396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.285846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.316886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.327348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4f442523-faf2-4715-b95f-795c84deb5db tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.372760 Aug 02 09:42:04.327931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1951/3264] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:04.350533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:04.351208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:04.357260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.357712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.358481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.358914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.417308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.425258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a4a406e9-b89f-45d6-b070-ba0c7eacc7f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153344 Aug 02 09:42:04.425828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1314/3265] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:04.486902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.490373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:04.496349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-95ee883d-63c0-4a39-9848-9363ba28576b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149591 Aug 02 09:42:04.496925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1952/3266] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:04 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:04.568111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:04.568654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:04.575277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.575729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.576500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.576941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.612928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:04.613708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:04.621057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.621547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.622361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:04.622798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:04.641628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.650123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.651674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.652836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-91d86a02-7805-429a-9a33-054ea2f55072 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088719 Aug 02 09:42:04.653519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1315/3267] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:04.684744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:04.692230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72d555b9-bb97-46d5-8d5a-ffd043b37ae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083121 Aug 02 09:42:04.692791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1953/3268] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:05.349246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:05.349863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:05.357490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.357939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.358695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.359135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.446779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:05.447403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:05.453565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.454018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.454790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.455235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.488251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.496405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e11ec8d-2028-44b8-873f-217720168d20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151013 Aug 02 09:42:05.497153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1316/3269] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:05.517919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:05.518536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:05.525357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.525826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.526593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.527037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.588778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.596791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40115eb6-9127-479e-bee0-520629ac5b6b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154012 Aug 02 09:42:05.597592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1954/3270] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:05.655806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.663808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-724dbe8d-cf19-4d64-a234-80f801e4dfc9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149675 Aug 02 09:42:05.664382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1317/3271] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:05 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:05.675728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:05.676336 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:05.682482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.682918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.683666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.684093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.713721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:05.714336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:05.720436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.720893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.721691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:05.722129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:05.745711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.754264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.755780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.756931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d56c75ce-ba77-495a-9b52-6eebe3355d1b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085108 Aug 02 09:42:05.758084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1955/3272] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:05.787004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:05.794743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-54ed3409-6c90-4e5c-b7e9-75c7c40657de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085450 Aug 02 09:42:05.795307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1318/3273] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:06.517595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:06.518216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:06.525356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.525830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.526573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.527020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.620333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:06.620938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:06.627817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.628284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.629061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.629544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.656126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.665364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8571c6ab-06cf-455e-9f2c-573ce6466a27 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151497 Aug 02 09:42:06.666131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1956/3274] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:06.684498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:06.685260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:06.691510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.691966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.692773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.693266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.763657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.772002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-551de32c-64aa-4937-8b76-949140e80165 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156200 Aug 02 09:42:06.772767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1319/3275] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:06.790860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:06.791465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:06.797567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.798021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.798808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.799779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.832051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.840735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dca7b305-e720-45f2-9401-272481dc4d01 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160128 Aug 02 09:42:06.841358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1957/3276] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:06 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:06.846796 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:06.847415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:06.854766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.855419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.856107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:06.856691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:06.862205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.870973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.872473 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.873671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bb843a4e-6f85-4ea4-afcb-67052afaaffd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087347 Aug 02 09:42:06.874243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1320/3277] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:06.919241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:06.926960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ca1c286-4eb9-4fdb-8d06-32dd7e983cd4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083833 Aug 02 09:42:06.927570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1958/3278] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:07.686850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:07.687461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:07.693963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.694418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.695996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.696438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.793958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:07.794572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:07.800909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.801382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.802139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.802573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.830067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:07.838257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4d20e23d-2003-4abe-a79a-2d9bb51e6943 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155364 Aug 02 09:42:07.838915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1321/3279] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:07.862620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:07.863261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:07.870170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.870625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.871402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.871844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.939444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:07.947830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4988007a-2eb1-418e-87cd-929c1019cfec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157738 Aug 02 09:42:07.948434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1959/3280] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:07.952978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:07.953631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:07.959506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.959958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:07.960803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:07.961292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.013102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:08.021105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6db55f24-f59c-4702-a4d2-9408d870d276 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.162394 Aug 02 09:42:08.021704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1322/3281] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:07 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:08.023532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:08.026167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:08.026774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:08.032679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:08.032951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:08.033411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.034172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:08.034567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:08.034703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.035714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3e456a54-8e34-4afb-83c4-1fcc626c7060 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086361 Aug 02 09:42:08.036270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1960/3282] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:08.095906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:08.104061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4dfb4af1-6edd-4c53-8a15-5f7a811f5dbb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081404 Aug 02 09:42:08.104624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1323/3283] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:08.859817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:08.860358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:08.867380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:08.867833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.868602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:08.869045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.969519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:08.970147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:08.976792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:08.977298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.978076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:08.978517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:08.999037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.007445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-94e6a801-c004-42ac-9d32-0eaf2fda7309 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151489 Aug 02 09:42:09.008941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1961/3284] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:09.042271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:09.042928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:09.048958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:09.049450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:09.050222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:09.050662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:09.112610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.121493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ca928eb2-a137-4b73-8d1d-296d54ad1a5d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155926 Aug 02 09:42:09.122079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1324/3285] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:09.126657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:09.127269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:09.133974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:09.134508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:09.135310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:09.135752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:09.189310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.197950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cce6778d-dfcd-4684-9e04-9aa596eff8e4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159565 Aug 02 09:42:09.198537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1962/3286] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:09 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:09.203362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:09.203985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:09.204848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.210150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:09.210692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:09.211468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:09.211907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:09.214421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.216119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.217388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-efbc0e9f-e30a-47e2-b25b-5f03fd9b9032 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094359 Aug 02 09:42:09.218031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1325/3287] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:09.272704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:09.280440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fac1ed8a-106d-45b6-8cb7-e72b9f86bf38 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080691 Aug 02 09:42:09.281021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1963/3288] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:09 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:10.029674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:10.030298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:10.036803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.037293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.038058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.038505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.143862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:10.144491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:10.151230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.151675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.152438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.152869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.168778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.176787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1e8ac658-3b8b-4dbf-b4e1-eec382e374f9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150934 Aug 02 09:42:10.177318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1326/3289] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:10 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:10.219353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:10.220113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:10.227050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.227517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.228300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.228735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.283038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.291610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-da43317c-9a21-4764-b1e5-0d129ed9043b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151668 Aug 02 09:42:10.292198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1964/3290] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:10.296780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:10.297415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:10.303553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.305100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.305397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.305934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.365863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.373920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.376088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b934d32a-de85-4765-804d-dbeb651a5eae tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160521 Aug 02 09:42:10.376676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1327/3291] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:10 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:10.381170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:10.381782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:10.382524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.384292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.385452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-38bfe342-959f-40e9-80e0-2f7dea125345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092311 Aug 02 09:42:10.397163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1965/3292] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:10 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:10.397358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.397358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.397358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:10.397358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:10.449991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:10.457408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b9db37c-e0e4-45ae-a5ec-be6e5a67cef4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.079715 Aug 02 09:42:10.457975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1328/3293] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:11.200890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:11.201645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:11.212016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.212486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.214191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.214636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.313557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:11.315519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:11.321620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.322072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.322847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.323282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.368142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.376224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f85349a6-dff0-4296-ad41-04c1837573c2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.181151 Aug 02 09:42:11.376817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1966/3294] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:11.398501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:11.399168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:11.405378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.405815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.406574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.407006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.460824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.464327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:11.469728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-99f0bbb5-ab92-428f-8add-4c9a3e5b41b4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159976 Aug 02 09:42:11.470312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1329/3295] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:11.475244 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:11.475455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:11.481961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.482852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.483635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.484078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.543445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.546483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.551779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c042054e-aac9-4b80-97d6-53b436be78fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157519 Aug 02 09:42:11.552361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1967/3296] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:11 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:11.556271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.557928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.558148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:11.558760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:11.559077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9445cc84-b47f-4f50-9783-b98332185b23 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087823 Aug 02 09:42:11.564908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.565303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1330/3297] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:11.565509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.566487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:11.566928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:11.634227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:11.647938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-396d2586-5c7d-433f-9164-1b9c19b11f75 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088438 Aug 02 09:42:11.648536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1968/3298] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:12.400794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:12.401431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:12.408270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.408812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.409608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.410063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.492369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:12.493031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:12.499747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.500198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.500972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.501465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.520627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:12.544046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.552186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e84a86c-9c3b-4698-a2ac-a355b4e48ff9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156230 Aug 02 09:42:12.552794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1331/3299] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:12.574486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:12.575157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:12.581192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.581664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.582421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.582859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.635831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.643990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8eccb60-9a20-4e82-b9e2-fa38841754a3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155784 Aug 02 09:42:12.644656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1969/3300] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:12.650052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:12.650762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:12.656938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.657428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.658280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.658712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.719312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.721334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.728102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aa45f7c1-62a4-4023-9c91-dd2f5c824662 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.158123 Aug 02 09:42:12.728690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1332/3301] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:12 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:12.733179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:12.733617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.733774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:12.735321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.736599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7d8a2ff2-b6cc-434f-bb09-1b997d21a6db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090894 Aug 02 09:42:12.737281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1970/3302] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:12.739701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.740151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.740912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:12.741381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:12.802737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:12.810851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e5500224-9079-4f35-83b3-38054420e7f8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081156 Aug 02 09:42:12.811421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1333/3303] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:13.574370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:13.574995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:13.578558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:13.582468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.582924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.583688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.584127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.666641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:13.667375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:13.674034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.674591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.675435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.675961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.715631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.723789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-579ee382-a80e-469b-b237-1098515175f0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154080 Aug 02 09:42:13.724379 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1971/3304] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:13.749739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:13.750348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:13.756699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.757170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.759067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.759497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.809584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.817612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d2e4b93-9fd5-4c30-9364-8bb01101b93a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154935 Aug 02 09:42:13.818186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1334/3305] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:13.823736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:13.824350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:13.835341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.836330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.837228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.837671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.894031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.902199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3c578613-1184-4c7e-adb8-51bf06c307ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156197 Aug 02 09:42:13.904274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.907645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1972/3306] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:13 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:13.912424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:13.913160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:13.914286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.917849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.919131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e8c6bc52-ee91-489f-a9fb-4d1437b74f5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.100023 Aug 02 09:42:13.919795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1335/3307] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:13.920180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.920752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.921565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:13.922278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:13.984352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:13.992711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e0630d86-bab2-4319-8c58-561c0da9c8e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083968 Aug 02 09:42:13.993310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1973/3308] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:14.745804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:14.746423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:14.752990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:14.753468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:14.754223 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:14.754657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:14.839854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:14.840472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:14.847404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:14.847859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:14.848629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:14.849067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:14.884268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:14.892249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-151d6246-7372-4424-8f08-4334e099aa11 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151466 Aug 02 09:42:14.892834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1336/3309] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:14.924053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:14.924671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:14.931728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:14.932190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:14.932959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:14.933638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:14.984914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:14.993910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-154153e3-5e41-435f-a32a-520bbc66fc88 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157905 Aug 02 09:42:14.994501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1974/3310] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:14 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:14.999306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:14.999925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:15.006478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:15.008609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:15.008609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:15.008931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:15.066030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:15.072016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:15.074229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e0dc0660-4cf2-4c19-b6a7-38f033e9b74b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154198 Aug 02 09:42:15.074815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1337/3311] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:14 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:15.079237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:15.079842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:15.080611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:15.082134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:15.083266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cbf44f6a-e589-48af-8d9b-617dee465075 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087849 Aug 02 09:42:15.084053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1975/3312] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:15.086202 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:15.086746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:15.087483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:15.087922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:15.151183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:15.158628 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e2fe2c8-88d5-4882-9731-41217921a5bc tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082869 Aug 02 09:42:15.159193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1338/3313] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:15.913903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:15.914529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:15.921439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:15.921571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:15.922263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:15.922867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.015849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:16.016469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:16.023106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.023571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.024348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.024785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.051757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.060698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-04588fe4-2364-4f7c-9cb2-7fe87ac20e67 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150700 Aug 02 09:42:16.061391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1976/3314] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:16.095827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:16.096452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:16.102817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.103271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.104044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.104847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.157926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.169558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ea6fda5-f568-4a70-8e5d-14ff2dff8ccf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157548 Aug 02 09:42:16.170072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1339/3315] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:16.174699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:16.175311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:16.182034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.182495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.183268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.183709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.244912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.251284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.254218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.255774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.256967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c20b6f53-eaba-4b69-8e87-ddea09115ac4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085960 Aug 02 09:42:16.257597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1340/3316] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:16.259584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c32cf439-b5dc-494c-b044-f35c8b0aa027 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.167639 Aug 02 09:42:16.260376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1977/3317] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:16 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:16.262439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:16.263056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:16.268993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.269588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.270422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:16.270933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:16.331481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:16.339124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4d1ebae-dfb3-43c0-801c-1b029a76227a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080554 Aug 02 09:42:16.339698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1341/3318] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:17.082364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:17.082973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:17.089704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.090150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.090900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.091331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.191482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:17.192300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:17.199249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.199783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.200558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.200994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.221279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.230060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-58c28ce5-ca62-443f-9887-4f8432b851f3 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151524 Aug 02 09:42:17.230638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1978/3319] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:17 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:17.279751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:17.280460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:17.286710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.287194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.287966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.288556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.335000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.343472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ec4129b3-85b3-463e-9902-c0ab5aaa80d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155976 Aug 02 09:42:17.344030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1342/3320] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:17.348516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:17.349164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:17.351446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.356909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.357442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.358191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.358620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.360605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.362156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.363351 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d2e58581-fbe7-456b-93cd-6ede55ddc4bd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087404 Aug 02 09:42:17.363956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1979/3321] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:17.368622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:17.369265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:17.375370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.375824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.377149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:17.377149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:17.446529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.454380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6f5c5e6d-3d1b-4ba8-85bc-0aa7c7222ca8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089327 Aug 02 09:42:17.455137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1980/3322] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:17.493065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:17.501008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-abb2dd7a-604c-4a02-8fd9-e3fded36998d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156040 Aug 02 09:42:17.501675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1343/3323] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:17 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:18.251905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:18.252475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:18.259907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.260382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.261159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.261594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.365849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:18.367039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:18.373566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.374033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.374855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.375301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.391658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.399869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff82eac1-a6be-4cfe-b3d3-7ca91c1dc3b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151862 Aug 02 09:42:18.400459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1981/3324] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:18.411930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:18.412551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:18.419481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.419937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.420712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.421176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.484224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.493722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.495219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.496459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f9db0b64-4c1e-4b04-bf85-879d6ed8802c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.095076 Aug 02 09:42:18.497029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1982/3325] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:18.509385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:18.509385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:18.516726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.517551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.519101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.519776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.521779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.529881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a3abedc9-1f41-40bd-a2dd-2ef16e723ffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.167861 Aug 02 09:42:18.530465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1344/3326] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:18.534993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:18.535517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:18.542304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.542888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.543894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:18.544524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:18.585097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.593016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30b17961-3993-4a4b-a6de-76666f3831b8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.094376 Aug 02 09:42:18.593714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1983/3327] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:18 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:18.675573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:18.684140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-71b8f47a-ffdf-40c7-b648-ca273eb4b6f8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152710 Aug 02 09:42:18.684716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1345/3328] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:18 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:19.421816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:19.422421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:19.430008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.430635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.431454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.431933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.520608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:19.521253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:19.528143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.528591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.529380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.530029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.548474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:19.562547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.570809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b631a56-4a9f-4d5c-bc87-92c7ad741d37 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152984 Aug 02 09:42:19.571400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1984/3329] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:19.575871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:19.576491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:19.582406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.582863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.583638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.584078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.594846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.604510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.606050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.607204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-56d41086-1d9d-4769-8ab7-032c3df496c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090408 Aug 02 09:42:19.607763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1346/3330] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:19.614246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:19.614973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:19.621873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.622447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.623325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.623768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.690211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.697830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17ba3a91-b388-4568-b3ef-f9845e84ed34 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087030 Aug 02 09:42:19.698397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1347/3331] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:19.708568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:19.709349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:19.715742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.716457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.716980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.717851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:19.718399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:19.723709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40e52184-eb14-48f1-8de8-428980745cc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151361 Aug 02 09:42:19.724280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1985/3332] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:19.847912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:19.856573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fc3958c4-98b3-4045-b08e-076165c7cc8a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151761 Aug 02 09:42:19.857156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1348/3333] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:19 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:20.591623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:20.592217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:20.598885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.599335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.600096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.600534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.605012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:20.630495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:20.631110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:20.638574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.639023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.639791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.640228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.704903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:20.713647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:20.715174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:20.716338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-18fee87a-6984-4799-8d1f-9188f3e1627f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089769 Aug 02 09:42:20.716893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1349/3334] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:20 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:20.721336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:20.721950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:20.731096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.731841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.732778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.733323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.736977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:20.746066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-835a2915-7a45-4acb-a9dd-62fd2fa12701 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158307 Aug 02 09:42:20.746651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1986/3335] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:20.751040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:20.751639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:20.757797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.758500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.759260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.759689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.796357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:20.804651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-526b848d-aec2-4758-8853-a67725882587 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086208 Aug 02 09:42:20.805438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1350/3336] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:20.878200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:20.878946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:20.885850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.886314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.887086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:20.887527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:20.893575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:20.902682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-290c2982-1875-4f6d-b6a5-6b0a276261cf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155043 Aug 02 09:42:20.903803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1987/3337] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:21.020051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:21.028043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c9731447-20f9-4d9d-9045-820adcede3cd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153838 Aug 02 09:42:21.028611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1351/3338] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:20 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:21.739685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:21.740248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:21.747332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.747781 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.748548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.748989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.767511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:21.768132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:21.774666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.775117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.775889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.776326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.811341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:21.820691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:21.822375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:21.823538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eb73af86-abaf-4b5f-8fc7-13227dd964a9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087929 Aug 02 09:42:21.824109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1988/3339] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:21.828461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:21.829092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:21.835092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.835683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.836446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.836879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.910968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:21.912299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:21.920558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c0b309ce-413b-43af-adb5-cc552b5a538b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156877 Aug 02 09:42:21.924014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1352/3340] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:21.924707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21813e1a-d5b0-4966-b40d-2f0b085155ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.098276 Aug 02 09:42:21.924707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1989/3341] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:21.926109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:21.926709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:21.933986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.934446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:21.935183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:21.935614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.049699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:22.050320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:22.056854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.057343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.058119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.058557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.068262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:22.076988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c04b5044-5d4d-4d31-88b3-0f0b10f57009 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154465 Aug 02 09:42:22.077756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1353/3342] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:21 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:22.188915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:22.197450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-815fddc7-b282-48fa-89c4-265b5e155c05 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151664 Aug 02 09:42:22.198038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1990/3343] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:22 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:22.846419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:22.847053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:22.854266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.854727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.855494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.855934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.917661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:22.926307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:22.927803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:22.929077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ad3c881-b4ef-4c1a-a817-4a0f1ba409d7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086513 Aug 02 09:42:22.930016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1354/3344] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:22.941528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:22.942683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:22.943934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:22.945083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:22.949649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.950100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.950863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.951299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.951434 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.951773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:22.952569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:22.953010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:23.021862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:23.030172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f79f4c77-5a58-4301-80d4-4bda746e15af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.090536 Aug 02 09:42:23.030786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1355/3345] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:23.088685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:23.097014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9eca6465-c785-4c9f-9112-14f972b8a9a9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159372 Aug 02 09:42:23.097625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1991/3346] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:23.099480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:23.100109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:23.106174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:23.106624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:23.107389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:23.107830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:23.219517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:23.220143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:23.226443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:23.226896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:23.227664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:23.228104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:23.239389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:23.248043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-65930e7c-e130-4029-ac20-3068f871e4e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153305 Aug 02 09:42:23.248633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1356/3347] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:23.355225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:23.363099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-28dd2e59-6bbe-4854-b9d3-7e9ca1af45ad tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147542 Aug 02 09:42:23.363694 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1992/3348] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:23 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:23.951910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:23.952516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:23.958927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:23.959369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:23.960185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:23.960704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.021282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.030159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.031633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.032767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e336216d-487d-4e27-bc77-9b074661e148 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084804 Aug 02 09:42:24.033357 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1357/3349] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:24.050085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:24.050703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:24.057700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.058151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.058912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.059348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.118425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:24.119055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:24.120106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.125259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.125724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.126501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.126944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.128083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ab18fe6-4aec-42f7-b0a3-1f965e825cd0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081879 Aug 02 09:42:24.128666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1993/3350] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:24.254897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.263170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c371c2e9-c8c7-463c-8152-f74d191c5f03 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148815 Aug 02 09:42:24.263738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1358/3351] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:24 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:24.270268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:24.270964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:24.277702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.278229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.278988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.279419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.385522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:24.386142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:24.392210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.392668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.393471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:24.393915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:24.413755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.422241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-849f0516-a4b8-459d-8990-0c5eb713ddc7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155698 Aug 02 09:42:24.422835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1994/3352] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:24.528272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:24.536198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-590dfdcf-5bf1-44d9-9383-6119bf1c2d39 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155499 Aug 02 09:42:24.536769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1359/3353] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:24 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:25.058210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:25.059042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:25.066674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.067228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.068189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.068672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.132489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.141671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.143177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.144403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7927fe59-adf7-41ec-b4f4-2709ca4f88e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092410 Aug 02 09:42:25.145724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1995/3354] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:25.150485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:25.150983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:25.157356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.157804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.158571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.158999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.234490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.242372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-151ce251-bbda-43f6-8f80-7ab63cd359d2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.096298 Aug 02 09:42:25.242971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1360/3355] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:25.284985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:25.285638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:25.291862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.292316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.293091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.293555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.424822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.433597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d882b973-2190-4b07-8cd5-ab9b857d70da tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152451 Aug 02 09:42:25.434190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1996/3356] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:25.443866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:25.444659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:25.447900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:25.451758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.452212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.452987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.453455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.557212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:25.557846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:25.563946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.564403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.565265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:25.565650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:25.619699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.627796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-530509f0-8cc2-42f4-965a-25a155514c09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.187786 Aug 02 09:42:25.628373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1361/3357] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:25.700226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:25.708256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-056831e8-ab58-4ca5-b847-64276f220ff3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155035 Aug 02 09:42:25.708870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1997/3358] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:25 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:26.167316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:26.167935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:26.174616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.175013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.175774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.176210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.236806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.245933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.247443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.248594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-80056829-b355-4d35-a77b-871439415985 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085213 Aug 02 09:42:26.249179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1362/3359] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:26.264085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:26.264704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:26.270915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.271362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.272122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.272560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.334618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.342642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3198a677-2b5c-4c90-ac11-a6007b8cec3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082345 Aug 02 09:42:26.343219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1998/3360] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:26.455443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:26.455985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:26.462150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.462604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.463369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.463811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.467802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:26.597788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.606168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26764b39-f68d-46eb-b929-4778602f5c5f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154721 Aug 02 09:42:26.606734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1363/3361] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:26.649376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:26.650000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:26.655954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.656413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.657271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.657719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.738330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:26.738982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:26.746201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.746648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.747422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:26.747854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:26.886493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.894956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0a85baf3-bd08-41a5-adca-e1029aa48efa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161527 Aug 02 09:42:26.895546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1364/3362] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:26 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:26.942669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:26.950711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b801e206-ef6a-4e60-b00f-b8581fc19e67 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.305300 Aug 02 09:42:26.951280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 1999/3363] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:27.271794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:27.272406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:27.279535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.279986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.280781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.281239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.342714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:27.351651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:27.353180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:27.354319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1c25a5f-786e-4074-8cb5-26c666804e2e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086468 Aug 02 09:42:27.354888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1365/3364] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:27.362544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:27.363164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:27.370621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.371075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.371843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.372283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.435988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:27.443496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02460f3c-11f1-4475-b987-7d8c6f52f9c9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084822 Aug 02 09:42:27.444069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2000/3365] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:27.628126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:27.628653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:27.635237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.635683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.636430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.636857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.766688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:27.775136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0fcb31e2-0691-4b35-b18b-e260fdfd9c76 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151024 Aug 02 09:42:27.775722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1366/3366] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:27.918353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:27.919215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:27.925355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.925815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.926601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.927038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.974422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:27.977654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:27.987075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.987564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:27.988479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:27.989025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.062027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.069960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f8ad48f6-d960-4ee9-bc88-5bc89c067db2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157819 Aug 02 09:42:28.070540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2001/3367] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:27 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:28.122115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.130425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-edf0e55d-9c47-4dbd-8a89-c0f2f25b91ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.162567 Aug 02 09:42:28.130994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1367/3368] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:28.377675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:28.378295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:28.385813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:28.386270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.387034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:28.387472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.448180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.451535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:28.457304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.460921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.462156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-19ae2a29-c328-4f9e-90df-9b53a7ddbf7a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088490 Aug 02 09:42:28.462747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2002/3369] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:28.465151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:28.465778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:28.472286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:28.472743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.473534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:28.473978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.537912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.546363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4fefb59c-166c-4955-88a0-ba38cb09a321 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086121 Aug 02 09:42:28.546935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1368/3370] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:28.797079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:28.797724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:28.804538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:28.805076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.805868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:28.806333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:28.940906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:28.949339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3db6c4e6-7232-42b1-9ffa-59080860530e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156255 Aug 02 09:42:28.949922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2003/3371] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:29.090735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:29.091348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:29.097468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.097916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.098673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.099143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.152436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:29.153047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:29.159170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.159613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.160401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.160882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.239376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:29.248644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a05fdc0a-d4bf-4a24-9ca2-46b40ba0355b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161735 Aug 02 09:42:29.249264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1369/3372] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:29 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:29.293826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:29.302025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1eeed6ce-c72e-453d-b818-68cb4bad01a6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153440 Aug 02 09:42:29.302614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2004/3373] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:29.485906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:29.486447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:29.493566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.494016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.494777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.495211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.559651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:29.567762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:29.568368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:29.568852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:29.570596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:29.571762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-89bc2c6a-87ee-473c-89e9-099a7881e673 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089924 Aug 02 09:42:29.572327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1370/3374] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:29.575321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.575839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.576679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.577136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.651642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:29.660647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab87995a-ef6e-47a5-a254-8654bfd63b86 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.095432 Aug 02 09:42:29.660647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2005/3375] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:29 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:29.971260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:29.971889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:29.978579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.979033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:29.980043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:29.980615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.129990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.138934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-91caff5c-04cc-44a6-a35a-7fef1819340f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.171522 Aug 02 09:42:30.139506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1371/3376] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:30.270563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:30.271183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:30.277524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.277980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.278738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.279175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.323582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:30.324200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:30.330130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.330581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.331347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.331786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.412187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.420831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9bfcfb88-e6b8-4f57-b32b-f439a9d6b7e8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154175 Aug 02 09:42:30.421472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2006/3377] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:30 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:30.467858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.475739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8da64fc5-cbc7-4d3f-bfad-972d3eb35616 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156793 Aug 02 09:42:30.476295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1372/3378] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:30.595930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:30.596478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:30.603082 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.603533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.604296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.604736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.666718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.675090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.676613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.677800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3ca5c2c9-18ae-4cab-a5d1-50c87ff80f0b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085952 Aug 02 09:42:30.678364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2007/3379] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:30 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:30.679715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:30.680322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:30.686286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.686735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.687483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:30.687916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:30.750278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:30.758805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d271c64-2ddb-4e9c-9957-fee45f154418 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083188 Aug 02 09:42:30.759367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1373/3380] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:31.159827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:31.160436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:31.168209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.168651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.169454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.169885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.302426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.311196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-63e74795-8c88-4b5c-b2d3-0b3483dde1a1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155242 Aug 02 09:42:31.311763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2008/3381] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:31.442487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:31.443027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:31.449078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.449555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.450305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.450738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.497989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:31.498610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:31.504625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.505077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.505883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.506324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.583238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.592142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3fd07367-97ce-48e1-ad6b-8533b6410e7b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153568 Aug 02 09:42:31.592728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1374/3382] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:31 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:31.642558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.651143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d35bff47-59ed-408b-9d11-995a27aab383 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157229 Aug 02 09:42:31.651712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2009/3383] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:31.700646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:31.701225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:31.707196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.707646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.708414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.708851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.774573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.779672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:31.780293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:31.783429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.784934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.786115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31606d79-0017-4d0f-888f-2191f690fc97 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089448 Aug 02 09:42:31.786299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.786675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1375/3384] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:31.786820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.787511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:31.787966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:31.849414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:31.857651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ca738280-04bf-466e-b84f-6d7224049ada tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082093 Aug 02 09:42:31.858231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2010/3385] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:32.332477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:32.333264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:32.339569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.340027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.340797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.341297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.482022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.493384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8c8d1ed6-3083-4113-b868-88e08caf8316 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.165523 Aug 02 09:42:32.493974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1376/3386] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:32.613890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:32.614427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:32.622567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.623020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.623794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.624235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.673139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:32.673855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:32.680549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.681072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.681945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.682483 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.757711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.766269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e1542628-17d4-47ad-8e61-5d2bb3064ac3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156363 Aug 02 09:42:32.766850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2011/3387] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:32 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:32.810385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:32.811036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:32.811377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.817192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.817653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.818424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.818894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.819927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6b87a9f-9def-460c-8372-ed48082bc476 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150145 Aug 02 09:42:32.820764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1377/3388] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:32.878677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:32.879267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:32.884802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.886736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.887189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.888013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:32.888480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:32.893700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.895209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.896350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a52569af-08e7-430a-ae77-f9933f83c63f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090066 Aug 02 09:42:32.896938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2012/3389] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:32.954429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:32.962954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7184dfad-6497-4288-a626-3093545e3f84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088348 Aug 02 09:42:32.963526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1378/3390] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:33.517436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:33.518059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:33.524147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.524598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.525401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.525844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.666650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:33.674689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fcc21989-233c-41a2-9eed-dc1dbebc4e94 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161230 Aug 02 09:42:33.675257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2013/3391] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:33.787698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:33.788922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:33.795463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.795916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.796681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.797139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.842194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:33.842819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:33.848812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.849311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.850080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.850595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.930566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:33.934036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:33.939782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f8b6e028-b9ce-4429-aa52-17ee52e0b757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156060 Aug 02 09:42:33.940353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1379/3392] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:33 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:33.945144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:33.945526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:33.951687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.952362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.953029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:33.953487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:33.988356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:33.996811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7482dbe4-596a-4a26-a9f2-dcf8df17fba1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158477 Aug 02 09:42:33.997426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2014/3393] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:34.002073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:34.002689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:34.012921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:34.013415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:34.014218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:34.014652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:34.016946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:34.026710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:34.028216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:34.029391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-011a8b24-664f-4dee-9811-7092050680e3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088080 Aug 02 09:42:34.030148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1380/3394] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:34.089501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:34.096957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-db6b989e-f5ec-4057-ae67-6d51979665ac tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.098579 Aug 02 09:42:34.097568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2015/3395] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:34.699503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:34.700107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:34.706227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:34.706671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:34.707420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:34.707851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:34.838099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:34.845920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c0e1b15-66d8-44fe-b240-972e484169f7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151173 Aug 02 09:42:34.846488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1381/3396] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:34.961876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:34.962419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:34.968838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:34.969315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:34.970078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:34.970506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.018817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:35.019433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:35.026018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.026488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.027245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.027685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.101071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:35.109266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69f40baf-6905-420e-a154-14983af6ca26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151904 Aug 02 09:42:35.109845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2016/3397] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:34 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:35.114844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:35.115439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:35.121593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.122035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.122800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.123232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.161834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:35.170514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-475abd11-29f7-45c8-8492-df73ba63c121 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155496 Aug 02 09:42:35.171090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1382/3398] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:35 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:35.175493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:35.176094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:35.182263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.185378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:35.185604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.186429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.186887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.193800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:35.195947 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:35.197094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-03e987fa-ee1d-4d5e-8977-e8a014875e89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086331 Aug 02 09:42:35.197680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2017/3399] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:35.249344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:35.257008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5d778210-5b28-4ed8-827d-2afe1e2c60b4 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084833 Aug 02 09:42:35.257707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1383/3400] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:35.867719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:35.868326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:35.874366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.874814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:35.875561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:35.875991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.011511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.019440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-02d8097a-c953-49cd-b78f-f650cfbdf5b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155775 Aug 02 09:42:36.020012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2018/3401] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:36.129812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:36.130339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:36.137837 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.138291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.139053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.139493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.192120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:36.192727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:36.199857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.200298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.201064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.201523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.220641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:36.275078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.280741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9b65e602-5d49-4669-b322-f20c981187c0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154843 Aug 02 09:42:36.281347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1384/3402] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:36 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:36.285987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:36.286630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:36.293059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.293613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.294378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.294814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.342701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.351296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b044ffb-4b8b-4a0a-a421-de825db64c9a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.163304 Aug 02 09:42:36.351878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2019/3403] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:36.356700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:36.357333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:36.357771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.363676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.364128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.364895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:36.365367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:36.367007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.368562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.369771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1dfbd86-db09-46d5-b43c-ab003f760345 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087507 Aug 02 09:42:36.370329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1385/3404] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:36.431987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:36.439563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a74e48ff-3929-44e5-89a2-f5dc908dd56c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086457 Aug 02 09:42:36.440137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2020/3405] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:37.045204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:37.046222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:37.052854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.053383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.054163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.054604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.193954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.202589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-128a37f3-e37d-4f3e-8641-585e24407548 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.166662 Aug 02 09:42:37.203166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1386/3406] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:37 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:37.310688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:37.311241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:37.314670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:37.318689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.319746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.320516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.320950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.371728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:37.372337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:37.378323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.379529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.379529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.379944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.457582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.471838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e13fc817-34f4-4612-bdff-aaf9364ba757 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.166608 Aug 02 09:42:37.472852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2021/3407] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:37 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:37.478831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:37.479448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:37.485668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.486130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.486909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.487346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.531822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.540338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aa339a7f-7155-4ac2-99a4-a4215c8596ae tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.172352 Aug 02 09:42:37.540907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1387/3408] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:37.546151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:37.546734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:37.552976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.553987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.553987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:37.555346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:37.555888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.565609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.567213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.568384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ddb032ba-bacd-433c-bd6c-b9f904ceea7d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094059 Aug 02 09:42:37.568989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2022/3409] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:37.619826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:37.627353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a833522e-7571-470d-92ce-137d5d02c95c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085472 Aug 02 09:42:37.627909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1388/3410] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:38.223896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:38.224424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:38.231056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.231501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.232258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.232688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.373019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.380962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa1ca50b-a987-47e9-914c-a6f6f1ec3bf4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161046 Aug 02 09:42:38.381841 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2023/3411] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:38.494475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:38.495025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:38.501736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.502182 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.502969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.503403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.562422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:38.563430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:38.575039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.575039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.575039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.575039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.638570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.646759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2d99c359-1c0a-4933-a010-d28f80c1a6b1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156289 Aug 02 09:42:38.648018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1389/3412] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:38 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:38.652720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:38.653356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:38.659333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.659791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.660565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.661007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.711487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.719568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4fb6a7fc-5a7d-43d1-93ed-28c395ddd187 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160996 Aug 02 09:42:38.720149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2024/3413] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:38.724575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:38.725204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:38.731619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.731869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.732297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.733074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:38.733532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:38.740539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.741848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.743007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2b8a5093-4654-4f8e-98a1-a9b4d66eca31 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094053 Aug 02 09:42:38.743760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1390/3414] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:38.799337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:38.808561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e5502ffc-2cc6-4c35-bed8-720b5f57365f tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087440 Aug 02 09:42:38.809289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2025/3415] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:39.402708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:39.403311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:39.409237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.409683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.410433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.410862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.540535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:39.549836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cbd38035-c4e5-41ba-8df0-e5ffdefec080 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150857 Aug 02 09:42:39.550415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1391/3416] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:39.669516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:39.671474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:39.678721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.679170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.679942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.680383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.741723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:39.742526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:39.748465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.748921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.749729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.750173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.815577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:39.824619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e97057d-5912-486f-a088-87ffc2941dc5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159053 Aug 02 09:42:39.837410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2026/3417] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:39 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:39.837410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:39.837410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:39.842838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.843564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.844821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.845560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.895268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:39.909198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f26ec3d1-42b8-4319-8fbb-2c7289d56c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.171743 Aug 02 09:42:39.910125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1392/3418] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:39.918579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:39.918579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:39.925921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:39.927363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.927981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.929127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:39.929753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:39.935105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:39.936640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:39.937844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-246a2bef-e9c7-4a71-8917-645be86b0366 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.111530 Aug 02 09:42:39.938415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2027/3419] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:40.008325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:40.015892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ef5d495f-baf5-4735-8ab0-448a401b4a5b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.104570 Aug 02 09:42:40.016457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1393/3420] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:39 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:40.573226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:40.573837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:40.580870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:40.581375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:40.582394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:40.582837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:40.720279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:40.729072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5ae06866-8a9e-4638-b365-b8d3cd1b457e tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159791 Aug 02 09:42:40.729671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2028/3421] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:40.851725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:40.852338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:40.859723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:40.860189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:40.860983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:40.861538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:40.932152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:40.932799 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:40.939044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:40.939497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:40.940261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:40.940720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.003797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.012884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ced22388-8dd7-49f7-82f4-010d1f36e526 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.166314 Aug 02 09:42:41.013491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1394/3422] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:40 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:41.018125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:41.018709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:41.025291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:41.025748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.026522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:41.027379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.080863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.092785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fad2c646-8c0e-47fa-b0d2-ac6fc83a0c6c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.164828 Aug 02 09:42:41.093414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2029/3423] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:41.094539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.097993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:41.098605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:41.105368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.106266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:41.106723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.107210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.107505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:41.107949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.108519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2a5a6be6-9480-4912-a8b4-f83745be6801 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094099 Aug 02 09:42:41.109138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1395/3424] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:41.169090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.176587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2416e4cc-037d-4477-b89c-8998d2dceae7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082222 Aug 02 09:42:41.177173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2030/3425] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:41.749766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:41.750390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:41.756858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:41.757332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.758346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:41.758778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:41.777456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:41.893180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:41.901751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ff781edc-71ea-4ad0-b9f4-bd70c490a00b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155798 Aug 02 09:42:41.902515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1396/3426] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:42.035052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:42.035696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:42.042376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.042831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.043595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.044037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.116686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:42.118156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:42.124351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.124642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.125451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.125890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.175640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:42.184200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-040f81db-6bf3-4909-8547-2a45b3f604b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153052 Aug 02 09:42:42.184771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2031/3427] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:42 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:42.191927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:42.192910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:42.200225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.200672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.201505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.201944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.259812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:42.268279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:42.268457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c7411ee-7922-4fb6-a952-c5cf825ccf8e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156460 Aug 02 09:42:42.268947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1397/3428] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:42 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:42.273501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:42.274123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:42.277342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:42.278899 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:42.279954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.280395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2eb5f739-0ac6-41a3-a0a6-f522e6a7d2e9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092323 Aug 02 09:42:42.280534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.281149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2032/3429] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:42.281282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.281809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.345767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:42.354014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-39e5b8e2-0ff2-4ac8-a18c-6c127facc4af tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084088 Aug 02 09:42:42.354586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1398/3430] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:42.922919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:42.923530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:42.930481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.930920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:42.931723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:42.932158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.064661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.073354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69221968-decb-420c-a3bb-4f400d209397 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154290 Aug 02 09:42:43.073930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2033/3431] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:43.205640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:43.206260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:43.213100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.213588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.214350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.214788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.291102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:43.291712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:43.297940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.298392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.299163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.299601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.345549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.354342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-99d78031-7bd9-4a54-8077-e62926b2070a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152551 Aug 02 09:42:43.354911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1399/3432] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:43.359380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:43.360002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:43.366327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.366787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.367651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.368094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.429652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.435367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.438162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.439682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.440839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f3027051-2aca-4b34-b293-78c1dc795c89 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084998 Aug 02 09:42:43.441438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1400/3433] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:43.443848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a69a508f-6a9c-4587-9da1-0f97912c8683 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157217 Aug 02 09:42:43.444647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2034/3434] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:43.446035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:43.446641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:43.453028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.453651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.454494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:43.455009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:43.515794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:43.524098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-19ac2e81-bfa9-43f1-badf-d4a42b3d2d3a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081707 Aug 02 09:42:43.524666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1401/3435] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:44.094759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:44.095370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:44.102137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.102588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.103352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.103783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.233414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.242191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0af25f78-e432-4949-81ad-d75e1fa982b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151291 Aug 02 09:42:44.242764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2035/3436] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:44.376290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:44.376912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:44.383800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.384252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.385018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.385493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.464712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:44.465292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:44.471468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.471920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.472692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.473151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.478019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:44.519719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.528552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8054b722-9355-4ffc-ad26-2ef57556cab2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156234 Aug 02 09:42:44.529154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1402/3437] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:44 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:44.534164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:44.534306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:44.537062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.541475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.541928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.542698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.543139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.546170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.547673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.548863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b95325ed-4447-4967-9d52-8683f6f41334 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088118 Aug 02 09:42:44.549453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2036/3438] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:44.554927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:44.555536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:44.561512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.561971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.563183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:44.563183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:44.624376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.633347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-35aa5a85-e349-4c53-8082-8a043cff4bf1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082612 Aug 02 09:42:44.633937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2037/3439] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:44.676281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:44.684821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-31132466-1b24-479d-a325-fff98aa6d855 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154717 Aug 02 09:42:44.685425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1403/3440] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:45.264071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:45.264691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:45.271313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.272293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.273092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.273554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.410469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.418391 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3ebc94a-1104-4a3a-9f10-17cc99504d9f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158243 Aug 02 09:42:45.418965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2038/3441] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:45.549269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:45.549785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:45.556288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.556728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.557514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.557945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.573576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:45.574189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:45.580060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.580522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.581329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.581769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.646835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.656814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.658367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.659532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6774873b-fa33-4738-a80b-8ab29af8b05b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090610 Aug 02 09:42:45.660097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2039/3442] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:45.666095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:45.666705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:45.672683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.673078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.673877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.674318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.698682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.706903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b15e42b8-cd15-45a4-985d-6e4fe2973b62 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161525 Aug 02 09:42:45.707572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1404/3443] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:45.712397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:45.713087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:45.719293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.719754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.720528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:45.720968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:45.736161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.744535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-103351bf-0575-409a-b123-18834d59e943 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083458 Aug 02 09:42:45.745228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2040/3444] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:45.849508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:45.858218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c0298d87-de09-4e82-9c34-f3091ef171b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149625 Aug 02 09:42:45.858788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1405/3445] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:46.439443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:46.440056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:46.446639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.447080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.447828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.448257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.579111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:46.587560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8ff9832-ba84-4cee-9fa3-1df4e5a15a83 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152094 Aug 02 09:42:46.588126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2041/3446] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:46.682813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:46.683428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:46.689946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.690331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.691080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.691511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.728671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:46.729415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:46.735822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.736281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.737060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.737529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.754639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:46.763672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:46.765229 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:46.766383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-74aacb3c-7b94-4396-93a3-add0854c4ff4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087566 Aug 02 09:42:46.766953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1406/3447] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:46.771312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:46.773009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:46.779091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.779548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.780313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.780941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.846995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:46.855411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e974fe70-1973-4824-b20e-8f4b64ba596c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087472 Aug 02 09:42:46.855991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1407/3448] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:46.872475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:46.879705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:46.880312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:46.880577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c12b7208-6c1c-42bc-be7d-d09c732e7099 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156439 Aug 02 09:42:46.881820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2042/3449] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:46 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:46.887138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.887583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:46.888333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:46.888765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.017565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:47.025513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63f00939-cc3c-4859-b7c8-966d9cd0be73 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149586 Aug 02 09:42:47.026083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1408/3450] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:47.609347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:47.609966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:47.617684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.618132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.618891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.619326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.751588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:47.760148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b1d44664-70da-4c5a-9373-1daa66696b23 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154743 Aug 02 09:42:47.760730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2043/3451] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:47.789651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:47.790269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:47.796836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.797344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.798110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.798552 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.860296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:47.869351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:47.870863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:47.872014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e7cd1a96-1ab8-4e38-bef9-9bbf1c5fb775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086824 Aug 02 09:42:47.872576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1409/3452] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:47.877623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:47.878233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:47.884557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.885000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.885777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.886207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.902616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:47.903242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:47.910179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.910632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.911411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:47.911852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:47.948360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:47.956099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c065b6d-2a77-4fc7-9e31-646d536dfe58 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082385 Aug 02 09:42:47.956686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2044/3453] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:48.043606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:48.046772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:48.047395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:48.051764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7cbcd84b-9b06-42e7-9cc7-29d56fb89d94 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152898 Aug 02 09:42:48.052429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1410/3454] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:47 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:48.053718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.054156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.054931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.055368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.183565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:48.196404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a3c1e9d9-d975-4885-b00d-5e46b44cafbe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153577 Aug 02 09:42:48.197042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2045/3455] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:48 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:48.781859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:48.782505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:48.785416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:48.789331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.789786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.790553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.790995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.895010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:48.895614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:48.902319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.902769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.903543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.903998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.924546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:48.933133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9da829c8-7bde-471d-ab1b-67d96cffe38f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155161 Aug 02 09:42:48.933713 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1411/3456] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:48.968478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:48.977139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:48.977331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:48.977806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:48.978637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:48.979780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3a50b5a6-8c44-4f69-8801-cbd795aac41a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088792 Aug 02 09:42:48.980588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2046/3457] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:48.984090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.984619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:48.985428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:48.985869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:49.046993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:49.055159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b01d02f5-0a7a-47ab-9ee6-dbd285916bd2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082019 Aug 02 09:42:49.055728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1412/3458] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:49.073968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:49.074587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:49.080553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:49.081009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:49.081803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:49.082249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:49.210962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:49.219010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-450ab636-8617-4c9e-884a-54698f2eb398 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148895 Aug 02 09:42:49.219192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:49.219749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2047/3459] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:49 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:49.219896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:49.226450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:49.226895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:49.227654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:49.228092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:49.231996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:49.358585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:49.367415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0155d683-df29-445d-a79b-325db470fcb6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152114 Aug 02 09:42:49.367985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1413/3460] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:49.810500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:42:49.810753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:42:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:42:49.955136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:49.955756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:49.963191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:49.963631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:49.964384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:49.964815 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.001703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:50.002437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:50.010003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.010458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.011262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.011698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.074787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.083251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.085414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.086603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-51835006-538c-4890-af5f-7845a38959cb tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088749 Aug 02 09:42:50.087164 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1414/3461] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:50.091565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:50.092171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:50.095337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.098132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.098585 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.099369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.099989 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.104359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff1b10bb-8c7f-471d-88c2-105b1f8640d4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153141 Aug 02 09:42:50.105013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2048/3462] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:50.161581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.169066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5be29bd0-c091-48b1-a948-84d0afefe429 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080872 Aug 02 09:42:50.169681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1415/3463] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:50.239875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:50.241270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:50.247342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.247788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.248543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.248971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.378457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.387516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8a4b930f-6bf4-40c5-8054-3001e96275a2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151619 Aug 02 09:42:50.388086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2049/3464] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:50.388519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:50.389154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:50.395056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.395505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.396261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:50.396728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:50.526910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:50.534852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f6b1bc38-9dd8-4ce8-a5f1-ab83e98cdd09 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150120 Aug 02 09:42:50.535423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1416/3465] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:51.109555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:51.110174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:51.116874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.117364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.118136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.118577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.124984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:51.125636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:51.132174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.132626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.133693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.134146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.182773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.191452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.192963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.194201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3482267-1715-4bce-ae6d-c5e4f7c3351c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088584 Aug 02 09:42:51.204790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2050/3466] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:51.204790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:51.204790 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:51.206208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.206909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.207801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.208319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.273436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.274286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.281121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0fe5edf3-3f65-4446-9d69-a28cba65fb41 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085375 Aug 02 09:42:51.282004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2051/3467] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:51.282408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5124346c-e1c1-4d19-82a1-e4cca3d4b7a2 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161225 Aug 02 09:42:51.283042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1417/3468] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:51.408122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:51.408653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:51.414783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.415227 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.415979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.416409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.546823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.550280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:51.556466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:51.556693 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39d9cdb3-45cc-4280-8f86-d5f75b8f35e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152189 Aug 02 09:42:51.557049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2052/3469] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:51.557509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:51.563620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.564124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.564879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:51.565352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:51.691570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:51.699527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62a0ac7e-f236-4013-bde7-d86ba3805741 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147593 Aug 02 09:42:51.700171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1418/3470] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:51.872601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:42:51.872791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:42:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:42:52.217897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:52.218546 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:52.225289 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.225755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.226516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.226951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.288559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.296967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.298520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.299665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7e5e7ce5-2a8c-4581-9de3-8bd036102cdc tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085732 Aug 02 09:42:52.300222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2053/3471] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:52.302890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:52.303691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:52.304909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:52.305584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:52.310572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.311027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.311292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.311745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.311866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.312288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.312501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.312936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.379813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.388086 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-27c4b9ce-4b75-4fc6-9bbe-69a12c58f4b2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089367 Aug 02 09:42:52.388651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1419/3472] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:52.441680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.449981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-55a15e74-aab9-4886-9c6a-04c396c84ca1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148833 Aug 02 09:42:52.450548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2054/3473] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:52.577818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:52.578426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:52.584896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.585535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.586288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.586719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.714020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.722207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63bdf3bb-04e2-47ad-b716-f49fdab34396 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148283 Aug 02 09:42:52.722742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:52.722879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1420/3474] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:52 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:52.723375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:52.730086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.730536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.731309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:52.731744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:52.861955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:52.869958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-522dffc3-a872-4d04-8a0d-ec0992763b3c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152539 Aug 02 09:42:52.870521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2055/3475] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:53.324040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:53.324688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:53.331297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.331754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.332573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.333011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.394553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:53.402777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:53.404399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:53.405572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2242c67-c964-4ffc-bce9-fb7d42242115 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085486 Aug 02 09:42:53.406152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1421/3476] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:53.409541 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:53.410165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:53.416938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.417432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.418197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.418637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.470835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:53.471447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:53.478936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.479395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.480027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:53.480175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.480607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.487880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-605babf8-90c2-4ca7-b40e-ec5cc09ff134 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082167 Aug 02 09:42:53.488545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2056/3477] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:53.613844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:53.622388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e765a8cb-fb66-4abb-b83c-3aa6b0e5a865 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155471 Aug 02 09:42:53.622963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1422/3478] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:53.745067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:53.745700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:53.751607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.752050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.752797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.753257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.879859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:53.888625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e0476d6-a469-4f31-babb-1709b09887bd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148130 Aug 02 09:42:53.889221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2057/3479] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:53 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:53.891680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:53.892293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:53.899009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.899460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:53.900220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:53.900655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.029143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:54.036910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8429a296-493d-454f-ae46-f8bfc1644e19 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149080 Aug 02 09:42:54.037655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1423/3480] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:54.428661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:54.429301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:54.435903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.436353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.437136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.437578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.502114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:54.508680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:54.509404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:54.511423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:54.512951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:54.514134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ee12092-ca6e-48ac-9ed8-9f5ebddcffc8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089988 Aug 02 09:42:54.515033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2058/3481] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:54.515985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.516439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.517235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.517677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.578784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:54.586196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-253aac54-874a-4017-9836-5aef86bf834b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081724 Aug 02 09:42:54.586753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1424/3482] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:54.643645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:54.644287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:54.650373 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.650829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.651592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.652030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.781461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:54.790562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fb13c878-4ebd-49ad-9129-c2d820a5409d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150733 Aug 02 09:42:54.791142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2059/3483] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:54.910381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:54.911025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:54.917947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.919032 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:54.919884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:54.920334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.058368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:55.059206 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:55.065606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.066123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.066976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.067511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.208333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:55.217066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f6105c36-3aa3-41d3-8c7a-c82036f0786b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.163021 Aug 02 09:42:55.217890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2060/3484] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:55 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:55.289638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:55.297548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8055ebf5-a0a4-46f7-890f-63bd3e45b6d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.391186 Aug 02 09:42:55.298119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1425/3485] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:55.536714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:55.538083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:55.544491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.544929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.545697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.546124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.606943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:55.607378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:55.607715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:55.614313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.614841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.615871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:55.616039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.616393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.617418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:55.618557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40776709-1a9e-4c95-9eb1-67039e6cc910 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085861 Aug 02 09:42:55.619317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2061/3486] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:55.678627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:55.686228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3645f23c-3ff3-49a2-a729-a0d7081c0dec tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083343 Aug 02 09:42:55.686794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1426/3487] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:55.812111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:55.812689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:55.819002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.819452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:55.820218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:55.820658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.014477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.023300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ddc104a7-d7b6-42d2-baa8-587cc81c3bd5 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.215172 Aug 02 09:42:56.023877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2062/3488] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:56.239165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:56.239688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:56.246503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.246959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.247721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.248161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.370746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:56.371408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:56.377466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.377916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.378677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.379110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.432285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.440591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2eb7d213-8ba5-4808-a793-b5cf73a11204 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.205348 Aug 02 09:42:56.441531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1427/3489] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:56.515302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.523232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fe7ffa51-b111-4400-8003-b497766356d0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.207900 Aug 02 09:42:56.523812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2063/3490] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:56 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:56.641839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:56.642449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:56.649139 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.649603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.650361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.650798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.707173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:56.707915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:56.714920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.716511 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.716949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.717775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:56.718219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:56.723566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.726433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.727649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dda6af73-12b8-4ee1-b650-42729d4e6ad4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089760 Aug 02 09:42:56.728216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1428/3491] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:56.780305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:56.788460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7f2df5c0-8f99-40f4-a85b-8715db666882 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085553 Aug 02 09:42:56.789022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2064/3492] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:57.044340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:57.044960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:57.051113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.051567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.052332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.052834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.179360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.182739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:57.187988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e9a8e46-a41a-4929-893d-075ee1995790 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147484 Aug 02 09:42:57.188549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1429/3493] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:57 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:57.464104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:57.464761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:57.471238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.471689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.472448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.472885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.544121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:57.544738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:57.550630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.551172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.551820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.552248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.602173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.610234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1476bf64-b9e2-44fd-a02b-5b00123632ad tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151153 Aug 02 09:42:57.610810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2065/3494] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:57.683461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.691321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-46c1a5e1-2bb4-4fbc-a921-af8aea7632fc tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151055 Aug 02 09:42:57.691890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1430/3495] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:57 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:57.751494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:57.752071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:57.759435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.759891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.760656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.761094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.810051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:57.810667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:57.816701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.817179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.817947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:57.819615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:57.825136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.834240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.835785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.836962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d54212f8-a85f-436a-9225-f13136e2153c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089407 Aug 02 09:42:57.837742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2066/3496] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:42:57.881885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:57.889472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad77ff78-6642-4df3-873d-5c32a721ece2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083417 Aug 02 09:42:57.890030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1431/3497] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:58.210500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:58.211117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:58.217260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.217718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.218475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.218915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.358753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.367194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1a0fc6b7-bddb-4eea-950a-6f3afc56db66 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161432 Aug 02 09:42:58.367767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2067/3498] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:58.632566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:58.633453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:58.639414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.639860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.640607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.641038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.713070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:58.713746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:58.720360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.720812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.721617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.722052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.771789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.780085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a3d79a1e-c06e-4401-b5c3-4d5d67349276 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152165 Aug 02 09:42:58.780647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1432/3499] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:58.852701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.859757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:58.860459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:58.861023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-79008362-4257-445f-9a98-f73a667ee815 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152014 Aug 02 09:42:58.861732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2068/3500] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:58 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:42:58.867622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.868074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.868842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.869308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.910863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:58.911406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:58.918268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.918724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.919535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:58.919993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:58.934484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.940421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:58.943446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.944956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.946138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-46a41443-940e-4389-a709-658a123c61fa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090233 Aug 02 09:42:58.946696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1433/3501] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:42:58.986730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:58.994849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dba08bf6-5281-47b9-99d3-cdf6562718e2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088081 Aug 02 09:42:58.995461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2069/3502] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:59.388386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:59.388992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:59.395017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.395462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.396240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.396732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.524478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:59.532318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e777618-500b-4760-b9bc-36e82b0ccf9d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147875 Aug 02 09:42:59.532882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1434/3503] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:59.655766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:42:59.655972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:42:59.801636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:59.802283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:59.808844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.809324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.810150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.810650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.882855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:59.883715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:59.890129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.890582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.891337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.891774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.944138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:42:59.952298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-73a0100e-2f88-4c90-a869-2e8dc9c2f16d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154480 Aug 02 09:42:59.952880 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2070/3504] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:42:59.967659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:42:59.968275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:42:59.971500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:42:59.977016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.977500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:42:59.978268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:42:59.978701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:00.026773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:00.035033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-106117f1-2602-495e-ae10-aa030858575b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156100 Aug 02 09:43:00.035796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1435/3505] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:42:59 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:00.040288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:00.040888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:00.041965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:00.047134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:00.047581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:00.048333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:00.048765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:00.051483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:00.053268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:00.054576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e5f1c92b-73c4-4e97-8de3-85847fb054f7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090701 Aug 02 09:43:00.055356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2071/3506] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:42:59 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:00.114200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:00.122001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a4aeafd-d525-4d83-b8f3-c924c186575a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085401 Aug 02 09:43:00.122564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1436/3507] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:00 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:00.554969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:00.555582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:00.561606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:00.562047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:00.562884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:00.563313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:00.691911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:00.700468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7b91de29-47a6-498f-baf3-64e57da9b301 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149915 Aug 02 09:43:00.701045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2072/3508] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:00.974547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:00.975298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:00.981426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:00.981875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:00.982633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:00.983074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.055991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:01.056725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:01.067569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.068569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.069387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.069832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.110502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.118700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a070f77d-4b10-4f1c-9f24-df685e23efe1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147949 Aug 02 09:43:01.119264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1437/3509] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:01.123730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:01.124335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:01.130162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.131115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.131882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.132323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.195096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.202847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.203784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.205318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.206463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-012e0c10-cb19-4c4e-a24e-290d2e606db6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086277 Aug 02 09:43:01.207017 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1438/3510] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:01 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:01.211095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8679397c-daa7-4a51-87a4-c7ee100b579d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159159 Aug 02 09:43:01.211822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2073/3511] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:01 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:01.211970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:01.212436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:01.218320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.224386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.225233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.225719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.291136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.298717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-49e37232-97a8-438c-ab53-0cbd6f6f90ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.090723 Aug 02 09:43:01.299277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1439/3512] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:01 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:01.722009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:01.722632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:01.729259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.729713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.730477 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:01.730921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:01.858125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:01.867459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f46b9bb4-bc47-44f9-832f-f0595b799b7f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149230 Aug 02 09:43:01.868047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2074/3513] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:02.139930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:02.140551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:02.147669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.148123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.148882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.149350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.231538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:02.232148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:02.238854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.239303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.240070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.240519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.279607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:02.287741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ae7998e3-e905-4dba-bffe-a68f2d0b16c4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151639 Aug 02 09:43:02.288316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1440/3514] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:02 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:02.292936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:02.293571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:02.299398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.299851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.300639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.301079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.306487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:02.315333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:02.317089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:02.319119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1ae9f480-4bd6-467c-af3a-c7272c1db48d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091323 Aug 02 09:43:02.319692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2075/3515] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:02 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:02.324109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:02.324736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:02.330657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.331100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.331863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.332294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.395256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:02.403686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1c173b5a-d58e-428b-a07c-1dc767e87625 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083008 Aug 02 09:43:02.404261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2076/3516] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:02 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:02.440127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:02.448528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1b181f49-933d-40df-a5ff-b8d2e98b7a28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159256 Aug 02 09:43:02.449085 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1441/3517] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:02 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:02.889328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:02.889965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:02.896041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.896668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:02.897482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:02.897920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.027159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.035119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1f409bcd-f052-46a0-9af1-730f2ffde85d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149744 Aug 02 09:43:03.035695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2077/3518] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:02 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:03.308907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:03.309496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:03.316135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.316587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.317396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.317913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.341751 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:03.342394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:03.348908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.349895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.350670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.351103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.415634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.424236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.425754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.426918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8a7fea3-daba-4eb1-833a-ebd3cd4fb219 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089179 Aug 02 09:43:03.427748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2078/3519] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:03 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:03.432649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:03.432825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:03.439161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.439888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.440894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.441365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.449955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.457963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8575c86e-96cc-4ea2-8acf-de664f8dc82f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152953 Aug 02 09:43:03.459461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1442/3520] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:03.469874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:03.470485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:03.477160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.477605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.478364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:03.478796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:03.506425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.514246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0b85042e-0260-4276-92bb-96a71e669258 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085520 Aug 02 09:43:03.514825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2079/3521] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:03 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:03.606370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:03.614278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c29aab0b-87e9-4af6-8825-028aefd354a1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148185 Aug 02 09:43:03.614840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1443/3522] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:03 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:04.056737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:04.057392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:04.063472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.063921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.064678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.065143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.192864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.201605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45c101fa-9d33-48b4-b4de-3442168e4283 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148604 Aug 02 09:43:04.202183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2080/3523] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:04.450896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:04.451423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:04.457954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.458477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.459349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.459794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.479779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:04.480396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:04.486782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.487232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.487996 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.488431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.521896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.530673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.532218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.533424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a917e2d5-3276-4b10-8cbd-0f9f755a4af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086536 Aug 02 09:43:04.533997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1444/3524] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:04 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:04.539564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:04.540327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:04.546350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.546803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.547577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.548029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.612921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.621823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-26017071-d974-4d6d-bf36-095309eb0add tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086824 Aug 02 09:43:04.622414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1445/3525] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:04 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:04.625691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.634641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-abcf296b-f825-44f9-a14a-5d5d266556bd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158823 Aug 02 09:43:04.649060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2081/3526] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:04.649263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:04.649263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:04.649263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.649263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.649680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:04.649680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:04.813909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:04.926978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:04.935010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-45a8f2eb-7f8e-4f49-b6d8-ee57af7daf10 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.303666 Aug 02 09:43:04.935570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1446/3527] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:04 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:05.222863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:05.223433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:05.230382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.230894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.231664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.232105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.358922 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:05.367099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5a265dd-f585-45a5-b6da-2172b18c717c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148242 Aug 02 09:43:05.367677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2082/3528] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:05.557330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:05.557939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:05.564432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.564880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.565733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.566169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.626259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:05.635449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:05.636977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:05.638145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b542b606-7eb8-4fa4-a8c9-d0149cf37b54 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084833 Aug 02 09:43:05.638710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1447/3529] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:05 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:05.643356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:05.643968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:05.651020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.651662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.652422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.652888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.655608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:05.656214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:05.662823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.663278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.664046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.664481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.714821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:05.722516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-390c8052-aede-412a-a1be-ad54cafb7737 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082995 Aug 02 09:43:05.724049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2083/3530] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:05 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:05.795995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:05.805043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a936e4e-89ca-40e5-b034-57d3ddf00bbd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153123 Aug 02 09:43:05.805633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1448/3531] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:05 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:05.955800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:05.956457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:05.962871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.963324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:05.964089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:05.964531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.093576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.102123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-47243aaa-222c-4331-a721-f4a1077d1eb3 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150243 Aug 02 09:43:06.102695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2084/3532] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:05 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:06.388869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:06.389533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:06.395485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.396581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.397376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.397816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.525486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.533420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e371024-217f-4afe-90aa-b9d399bdf325 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148394 Aug 02 09:43:06.533982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1449/3533] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:06 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:06.661668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:06.662337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:06.668778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.669254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.670016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.670444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.732456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.741788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.743307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.744466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c119c574-edd9-42dc-9e87-5b4f2719e74e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086846 Aug 02 09:43:06.745023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:06.745512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2085/3534] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:06 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:06.745673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:06.752195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.752646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.753429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.753864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.816427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.824216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-45bba5df-c3ae-4c84-bc37-536e4439d2ef tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084294 Aug 02 09:43:06.824774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1450/3535] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:06 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:06.827374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:06.828060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:06.834843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.835297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.836061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:06.836497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:06.840472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:06.967225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:06.976805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b5ed56a3-6399-4ed1-af69-19ba89bfc1e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.153399 Aug 02 09:43:06.977412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2086/3536] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:07.123896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:07.124511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:07.130672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.131210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.131975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.132420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.264301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:07.272762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-373c9eb4-53fd-4cb4-8c96-2af277280d88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152713 Aug 02 09:43:07.273494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1451/3537] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:07 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:07.554669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:07.555281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:07.561368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.561814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.562559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.562984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.694299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:07.702229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54ed0977-3d58-4810-ab32-73f95b59c4d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151627 Aug 02 09:43:07.702800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2087/3538] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:07.768524 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:07.769189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:07.776209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.776658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.777465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.778292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.839889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:07.844686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:07.845335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:07.848441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:07.850111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:07.851260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-06d041d8-01dc-4961-b42e-e966ddcbc963 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086637 Aug 02 09:43:07.851635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.852459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1452/3539] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:07 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:07.852646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.852849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:07.853363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:07.914579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:07.922272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cbb01dc3-3394-4e15-b476-9b97509f9b5a tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081362 Aug 02 09:43:07.922851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2088/3540] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:07 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:07.998247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:07.998858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:08.004814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.006078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.006845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.007285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.135088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:08.142877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b7a3b657-39a7-48e1-909c-8a10ea963fe5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148516 Aug 02 09:43:08.143433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1453/3541] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:08.294171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:08.294779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:08.300883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.301353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.302695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.303276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.439294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:08.447521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5d56f4e6-63c0-4330-8164-dad42dc78613 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157198 Aug 02 09:43:08.448096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2089/3542] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:08 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:08.723626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:08.725320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:08.731319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.731768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.732557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.732994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.864565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:08.873214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3cc0a30a-470e-4cf8-ac82-ebc621a75748 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153504 Aug 02 09:43:08.873773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1454/3543] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:08.875026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:08.875642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:08.882086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.882527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.883572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.883984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.944432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:08.945187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:08.949500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:08.951619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.952067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.952836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:08.953301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:08.957834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:08.959938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:08.961088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-751928a9-11f9-4d65-ad7f-147e2b539fbd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089977 Aug 02 09:43:08.961679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2090/3544] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:08 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:09.017387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:09.025846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e3203f5-2dad-47c0-8bae-ab59409f56eb tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085829 Aug 02 09:43:09.026411 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1455/3545] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:08 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:09.163794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:09.164413 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:09.170436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.170886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.171646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.172081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.299171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:09.307344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a5fcd172-2011-4e4e-9ee1-6a670689bb0d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.147475 Aug 02 09:43:09.307906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2091/3546] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:09 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:09.468291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:09.468907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:09.475132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.475584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.476346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.476790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.604074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:09.612163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9c712588-3577-46b3-9b72-0e45054b2f06 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147728 Aug 02 09:43:09.612748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1456/3547] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:09 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:09.672966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:43:09.673240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:43:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:43:09.895146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:09.895779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:09.902290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.902734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.903491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.903924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.985586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:09.986207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:09.993526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.993980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:09.994758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:09.995198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.033649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.043120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bddb4c68-24f8-4fdb-b1f6-eea7f336c6dc tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151839 Aug 02 09:43:10.044172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2092/3548] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:09 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:10.048747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:10.049383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:10.056165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:10.056621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.057414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:10.057852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.062212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.070789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.072299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.073472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07ab5387-d0f8-44e5-b091-1448ac724a0c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091935 Aug 02 09:43:10.074026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1457/3549] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:09 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:10.329466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:10.330221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:10.337409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:10.337864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.338653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:10.339095 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.342340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.350688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d8ec1863-9751-4183-a392-6ec28185dc84 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.305433 Aug 02 09:43:10.351335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2093/3550] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:10 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:10.477835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.485709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-73b6e9ad-a366-444c-b828-edffaf8acecc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160382 Aug 02 09:43:10.486269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1458/3551] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:10 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:10.634540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:10.635067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:10.641022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:10.641496 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.642254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:10.642681 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:10.782626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:10.792217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-45667632-a7dd-4c63-8ec7-8f3e2c7cc160 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161956 Aug 02 09:43:10.792800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2094/3552] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:10 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:11.066843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:11.068688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:11.077633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.078130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.079429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.079878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.095911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:11.096528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:11.103219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.103679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.104452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.104890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.188440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.198328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.199849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.201018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a04ce9b3-d44e-4204-91a9-93700acc5eb8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.109097 Aug 02 09:43:11.201882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2095/3553] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:11 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:11.230235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.239908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b1f5380a-a0d0-45e8-a50c-afe2ec744626 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.177922 Aug 02 09:43:11.241528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1459/3554] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:11 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:11.372381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:11.373014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:11.380500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.381280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.381806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.382308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.450178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.457742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eeac2436-8821-4f75-bfcb-1ef9fb8f774e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089464 Aug 02 09:43:11.458309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2096/3555] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:11 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:11.507562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:11.508427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:11.514481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.514925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.515682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.516121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.645007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.653410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-900e7896-8866-48d4-bf7e-5ef520006300 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149722 Aug 02 09:43:11.653964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1460/3556] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:11 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:11.814792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:11.815436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:11.821629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.822078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.822837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:11.823273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:11.962622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:11.970616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-31d02375-6cac-42cd-920b-3ea23980f6fb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159736 Aug 02 09:43:11.971179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2097/3557] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:11 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:12.226931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:12.227465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:12.230915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:12.235081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.235539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.236315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.236757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.262408 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:12.263068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:12.269581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.270063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.270837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.271349 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.300690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:12.309316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:12.310834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:12.311980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7199a7d7-c0a7-410e-bab1-8f823853f928 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089091 Aug 02 09:43:12.312534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1461/3558] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:12 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:12.400418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:12.409960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18b07b89-440f-4aab-9d9e-3cff2b6da5ce tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.151432 Aug 02 09:43:12.410531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2098/3559] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:12 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:12.484442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:12.484973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:12.492169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.492617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.493414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.493851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.558500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:12.565998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-58e407a9-2059-4ff0-950a-a7ab6f9dadcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085799 Aug 02 09:43:12.566553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1462/3560] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:12 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:12.676972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:12.678228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:12.684208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.684657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.685458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:12.685912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:12.817080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:12.825822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdce1c31-d77a-4464-b405-9048f22403d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152720 Aug 02 09:43:12.826392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2099/3561] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:12 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:12.993371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:12.993974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:12.999890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.000334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.001084 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.001535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.006567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:13.134916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.142791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9e676407-db7c-4483-978b-51935ade5ea0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153939 Aug 02 09:43:13.143340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1463/3562] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:12 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:13.336784 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:13.337365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:13.344254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.344699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.345489 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.345925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.407048 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.415938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.417459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.418584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3cdff35c-483b-4351-8aad-3c01e487fc40 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086518 Aug 02 09:43:13.419139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2100/3563] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:13 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:13.431578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:13.432194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:13.438658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.439109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.439875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.440310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.568622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.576554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ea65d729-bb36-4568-a817-2e4edd3ee059 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148804 Aug 02 09:43:13.577145 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1464/3564] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:13 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:13.587132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:13.587817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:13.593943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.594394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.595160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.595596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.655732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.663960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ab769d9-8851-46aa-9cf5-d32d24dac2d9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080767 Aug 02 09:43:13.664529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2101/3565] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:13 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:13.847369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:13.847909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:13.854758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.855206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.855959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:13.856414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:13.988034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:13.995929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0141d261-ff68-4798-af36-daa8eb320e98 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152512 Aug 02 09:43:13.996482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1465/3566] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:13 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:14.165334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:14.165872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:14.172077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.172530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.173348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.173805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.304386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:14.307759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:14.313067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a050a67c-0434-4135-a55d-b6c47d7ed385 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152282 Aug 02 09:43:14.313663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2102/3567] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:14 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:14.441298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:14.441856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:14.448871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.449590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.450435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.450877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.513274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:14.522481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:14.523994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:14.525157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c391b291-959d-47e8-ab43-be3915a7f9e5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087881 Aug 02 09:43:14.525711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1466/3568] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:14 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:14.597165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:14.597860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:14.604553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.605006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.605835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.606272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.684582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:14.685216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:14.691249 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.691750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.692458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:14.692890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:14.733406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:14.742050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8cc08ce9-f947-4ea5-a354-c8ac54e9bc25 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148712 Aug 02 09:43:14.742677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2103/3569] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:14 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:14.753899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:14.762803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bc6bd6cc-fa74-4b9d-bd70-ca3fab7f26ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081918 Aug 02 09:43:14.763484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1467/3570] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:14 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:15.017659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:15.018284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:15.024411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.024862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.025678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.026116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.156186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.164760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b654caa5-a700-45c8-bffd-98182030faa2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.151007 Aug 02 09:43:15.165375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2104/3571] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:15 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:15.335624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:15.336170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:15.342212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.342661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.343420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.343858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.476591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.484793 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c9bb67e8-e431-4298-a13d-cd0aa0a8673e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153122 Aug 02 09:43:15.485444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1468/3572] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:15 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:15.547724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:15.548330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:15.554658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.555105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.555858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.556295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.617256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.625623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.627222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.628354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd20120f-8b50-45cd-b7a1-6be9eed8d051 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.084521 Aug 02 09:43:15.628908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2105/3573] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:15 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:15.764510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:15.765177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:15.771799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.772259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.773027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.773739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.783678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:15.784292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:15.790304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.790753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.791515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:15.791953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:15.853470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.861098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-818f0fb2-b094-47e7-b40f-0f5af989bbcf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081241 Aug 02 09:43:15.861698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2106/3574] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:15 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:15.905668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:15.913754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a77ccead-b57c-42f8-81ec-36c27b0abb1b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153121 Aug 02 09:43:15.915094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1469/3575] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:15 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:16.186833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:16.187396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:16.194696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.195147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.195919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.196364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.323641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:16.331650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-18c3ea5b-c2f6-4926-89e6-373328d39769 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148830 Aug 02 09:43:16.332220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2107/3576] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:16 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:16.506558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:16.507179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:16.514040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.514494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.515260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.515717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.644397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:16.651430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:16.652049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:16.652923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0c5d2ef1-b2a6-4fdf-a0b5-23c724955f6c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150853 Aug 02 09:43:16.653521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1470/3577] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:16 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:16.659210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.659666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.660439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.660878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.726233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:16.734750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:16.736252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:16.737418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-08698b04-c82d-41a4-91cb-1b8ac085dcbf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089901 Aug 02 09:43:16.738002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2108/3578] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:16 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:16.881980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:16.882594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:16.888848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.889335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.890100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.890539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.937025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:16.937670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:16.944313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.944758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.945549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:16.945986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:16.955040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:16.962915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0bc824f1-0a5c-4b40-9a36-65b9886f458d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085478 Aug 02 09:43:16.963476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1471/3579] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:16 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:17.080951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:17.089377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-55977cc4-3eac-47e7-a48a-d72e00552d56 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.156860 Aug 02 09:43:17.089952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2109/3580] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:16 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:17.353891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:17.354428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:17.360396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.360848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.361635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.362075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.489486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:17.498002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63f45cd1-5da8-4bbe-8c49-1de71ed040b5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148687 Aug 02 09:43:17.498561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1472/3581] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:17 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:17.674495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:17.675041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:17.682303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.682759 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.683521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.683962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.762025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:17.762686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:17.768960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.769446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.770200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.770629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.811881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:17.820875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e26bb7e3-76e0-4b51-a376-21dce4ba7837 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150331 Aug 02 09:43:17.821482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2110/3582] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:17 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:17.833071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:17.841745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:17.843261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:17.844427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3fba816c-766f-4caf-8704-35a0f75a706e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086611 Aug 02 09:43:17.844977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1473/3583] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:17 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:17.984027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:17.984579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:17.991648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.992100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:17.992969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:17.993460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.057698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.065096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5f3301a4-a1ee-4d50-8d17-b743a072c94d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085122 Aug 02 09:43:18.065680 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2111/3584] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:17 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:18.110400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:18.111023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:18.117731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.118181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.118944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.119383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.248430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.256397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1a49b53-da91-48c9-b0f5-ed60f0f82453 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150031 Aug 02 09:43:18.256960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1474/3585] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:18 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:18.519587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:18.520205 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:18.526748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.527195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.527951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.528387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.656600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.665367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d80e396b-0a62-40d6-b422-1e18b259bccb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149726 Aug 02 09:43:18.665939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2112/3586] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:18 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:18.842088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:18.842639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:18.849928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.850574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.851361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.851808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.867126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:18.867750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:18.874222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.874676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.875438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:18.875872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:18.941487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.950807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.952319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.953490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a0661dfe-ca47-4b41-871e-13c7f3227325 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090426 Aug 02 09:43:18.954059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2113/3587] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:18 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:18.985137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:18.993131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-82a77106-a085-4f49-98f9-90b46cf96069 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155027 Aug 02 09:43:18.993711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1475/3588] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:18 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:19.086442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:19.087058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:19.093163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.093571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.094338 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.094777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.158564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:19.166259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f76a4880-ea13-4ab4-a6a1-ce42a20ce33e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084272 Aug 02 09:43:19.166825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2114/3589] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:19 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:19.277838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:19.278453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:19.284365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.284819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.285604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.286048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.416239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:19.424100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-368c7595-65d1-4de1-b362-9e3ca027372f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150200 Aug 02 09:43:19.424650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1476/3590] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:19 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:19.686807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:19.687344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:19.693587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.694037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.694797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.695230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.825307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:19.834938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff0a5d8a-58f1-4bdc-bc2c-9c475d235274 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152034 Aug 02 09:43:19.835534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2115/3591] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:19 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:19.978615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:19.979153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:19.985619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.986065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:19.986825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:19.987261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.014953 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:20.015565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:20.023464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.023915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.024689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.025150 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.049753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.058587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.060096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.061321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-350cd434-0394-4b2f-ac43-f34e7ddf280e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087920 Aug 02 09:43:20.061881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1477/3592] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:19 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:20.155325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.164125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e219d14d-c145-4683-b375-b843f526aaee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153195 Aug 02 09:43:20.164701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2116/3593] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:20 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:20.186964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:20.187608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:20.193936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.194398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.195168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.195611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.257315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.265201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ec95eefc-f482-4b99-8333-1b512d658e48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081969 Aug 02 09:43:20.265773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1478/3594] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:20 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:20.313186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:43:20.313338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:43:20.446121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:20.446760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:20.452984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.453525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.454293 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.454732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.592095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.600224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f963f36e-6dba-434a-b038-ecbd5caea351 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.158513 Aug 02 09:43:20.600803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2117/3595] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:20 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:20.855620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:20.856170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:20.862286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.862739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.863499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:20.863941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:20.995096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:20.998548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:21.004033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cfa9d301-16c1-46a9-b720-8a505034b34b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152357 Aug 02 09:43:21.004592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1479/3596] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:20 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:21.084108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:21.084724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:21.091345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.091800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.092562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.093007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.155234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:21.164165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:21.165718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:21.166865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c6ad6b0e-cc5c-49a8-89f1-c01b0a4e2678 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086709 Aug 02 09:43:21.167433 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2118/3597] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:21 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:21.185927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:21.186566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:21.192481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.192931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.193725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.194198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.286936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:21.288060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:21.294215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.294666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.295428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.295860 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.313980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:21.327983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:21.336702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-369469c2-3645-42dc-af8e-5282987b681d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154843 Aug 02 09:43:21.337503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1480/3598] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:21 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:21.360598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:21.368188 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-91d67596-2521-418b-95b3-94c85cd8e676 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085127 Aug 02 09:43:21.368754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2119/3599] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:21 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:21.620817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:21.621455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:21.627479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.627931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.628687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:21.629133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:21.757022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:21.765183 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c40e96e5-4cd3-4459-abb2-7ca347726551 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.148278 Aug 02 09:43:21.765731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1481/3600] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:21 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:22.027022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:22.027667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:22.033782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.034229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.034993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.035428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.164868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.172845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-43f45b75-d186-4e8e-b397-7ca91648827b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150474 Aug 02 09:43:22.173516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2120/3601] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:22 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:22.189087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:22.189723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:22.196757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.198002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.198439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.262677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.271040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.273088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.274753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-666a2566-5fd2-4471-92f8-7eba39066822 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.089635 Aug 02 09:43:22.275310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1482/3602] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:22 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:22.358641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:22.359286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:22.362207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:22.366254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.366763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.367538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.367980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.388018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:22.388627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:22.394635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.395091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.395854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.396297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.457702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.465762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1d542e70-6643-47aa-9b26-0d76baa30c48 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081503 Aug 02 09:43:22.466326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1483/3603] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:22 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:22.497689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.505819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f09f5d21-8087-4fa7-af69-b467f3107e9f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151042 Aug 02 09:43:22.506904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2121/3604] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:22 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:22.786848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:22.787471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:22.793595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.794048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.794816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:22.795255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:22.924157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:22.932809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7fd77527-8dff-433c-8ede-76910e7aa49f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149819 Aug 02 09:43:22.933403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1484/3605] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:22 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:23.195510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:23.196111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:23.202586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.203029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.203788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.204219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.298067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:23.298698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:23.306096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.306549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.307323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.307764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.337311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:23.345357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eec58bec-685b-4df8-b452-a79f3bc3cfc2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154527 Aug 02 09:43:23.345937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2122/3606] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:23 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:23.369720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:23.378174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:23.379685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:23.380831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-df918354-2d43-4211-a1ff-ebe0cfc2770d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086642 Aug 02 09:43:23.381418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1485/3607] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:23 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:23.487144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:23.487699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:23.494615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.495066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.495838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.496278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.526710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:23.527456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:23.533697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.534227 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.535006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.535452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.558168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:23.566147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a338c797-ffb3-46ce-bdea-936cf648d878 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082849 Aug 02 09:43:23.566734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2123/3608] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:23 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:23.670535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:23.678442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c0b6f1c-0ce7-4c2d-8eec-dcf8d743dd16 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155655 Aug 02 09:43:23.679003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1486/3609] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:23 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:23.955005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:23.955621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:23.962453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.962906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:23.963667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:23.964107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.092269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.100563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-59f0bb3a-ec81-433c-b6ec-12900b3331cb tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149252 Aug 02 09:43:24.101159 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2124/3610] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:23 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:24.366454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:24.367070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:24.373539 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.373993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.374754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.375194 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.404053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:24.404782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:24.411462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.411905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.413443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.413443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.476401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.484881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.486420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.487567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd5ab290-98bb-44a6-949d-01ec4bfe33d2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087432 Aug 02 09:43:24.488138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2125/3611] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:24 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:24.510407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.518408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf3c5c0d-b5cf-4e82-9a9a-eba6e63b3b35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.155870 Aug 02 09:43:24.518964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1487/3612] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:24 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:24.587575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:24.588191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:24.594622 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.595014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.595791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.596230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.660256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.668439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4dae449a-c55a-4661-bbd8-b234b073d604 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085517 Aug 02 09:43:24.669009 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2126/3613] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:24 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:24.699213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:24.699812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:24.705822 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.706267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.707012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:24.707443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:24.839640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:24.847619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eb14ac3a-7cef-4c3d-8d9c-bfe01bf8cafe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152095 Aug 02 09:43:24.848113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1488/3614] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:24 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:25.122407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:25.122942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:25.129006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.129503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.130260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.130695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.259910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:25.267850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0b55e488-a726-47d3-9770-68b1c12200b9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149400 Aug 02 09:43:25.268411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2127/3615] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:25 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:25.511292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:25.511899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:25.518267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.518718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.519472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.519905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.540358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:25.540973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:25.547575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.548023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.548789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.549269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.582955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:25.592285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:25.593959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:25.595137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-01613d82-967c-4e97-aaf0-8c8be8a425df tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088733 Aug 02 09:43:25.595684 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1489/3616] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:25 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:25.683078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:25.690491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:25.691020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab4b8c32-37c0-4d14-abf5-ec7e0713c564 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154775 Aug 02 09:43:25.691140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:25.691593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2128/3617] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:25 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:25.697785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.698240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.699013 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.699454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.760143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:25.767748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-955e18bc-d675-4941-a5d1-33d1888dfcab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080956 Aug 02 09:43:25.768240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1490/3618] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:25 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:25.869588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:25.870209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:25.876240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.876692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:25.877495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:25.877933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.015913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.024712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2b26c4c9-fd48-44c8-9832-9d47834b61b5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159442 Aug 02 09:43:26.025384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2129/3619] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:25 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:26.290882 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:26.291501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:26.297619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.298075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.298878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.299322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.518213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.527211 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dbeecbcd-7073-4060-85f9-8fe32d7229d0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.240999 Aug 02 09:43:26.527775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1491/3620] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:26 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:26.619898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:26.620586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:26.626717 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.627162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.627919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.628354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.691358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.699619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.701130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.702276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3961fc1a-ab0d-42b7-8430-c2eaae69ff49 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087099 Aug 02 09:43:26.702838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2130/3621] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:26 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:26.718454 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:26.719070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:26.725094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.726394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.727169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.727613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.790270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:26.791035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:26.797075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.797570 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.798339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:26.798780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:26.860306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.860945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:26.868908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3c9227e-5cd6-46f8-93bd-0a0a3b4974ea tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083028 Aug 02 09:43:26.869213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b4f060d2-0433-4386-a80c-db2873d929e6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154664 Aug 02 09:43:26.869665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2131/3622] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:26 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:26.870044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1492/3623] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:26 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:27.046674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:27.047296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:27.054637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.055094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.055864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.056305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.188554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:27.196991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-184036da-2a08-4270-b843-736aeeb7836a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154260 Aug 02 09:43:27.197586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2132/3624] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:27 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:27.549508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:27.550123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:27.557215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.557663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.558419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.558848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.690384 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:27.699009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c495748-9c0b-4a8f-ba23-5d9ceaafad75 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153414 Aug 02 09:43:27.699568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1493/3625] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:27 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:27.725444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:27.726075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:27.732424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.732872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.733817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.734247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.795770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:27.804775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:27.806330 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:27.807472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2c5ef1e2-dd4b-40dd-8f7c-7efd6486c4de tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086508 Aug 02 09:43:27.808035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2133/3626] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:27 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:27.889497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:27.890110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:27.890672 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:27.891306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:27.896295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.896915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.897546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.897666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.897978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.898106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.898831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:27.899272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:27.972232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:27.980651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-402c70f1-f737-494b-9e69-3cf96993b5dd tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.094929 Aug 02 09:43:27.981364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1494/3627] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:27 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:28.048384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:28.057318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8968dd65-d2ca-419f-83ed-a6af4610dc35 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.170286 Aug 02 09:43:28.057828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2134/3628] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:27 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:28.218603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:28.219207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:28.225829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:28.226276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:28.227053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:28.227486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:28.356150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:28.364160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-585ef367-35a8-46e0-9829-814b512e2fb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149432 Aug 02 09:43:28.364725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1495/3629] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:28 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:28.720046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:28.720576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:28.726659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:28.727229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:28.727857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:28.728291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:28.829538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:28.830158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:28.837280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:28.838582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:28.839484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:28.839923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:28.857450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:28.858709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:28.866026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-92351ea3-c57e-4d70-97bd-f8a9f2b3ed20 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149343 Aug 02 09:43:28.866769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2135/3630] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:28 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:28.905188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:28.913884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:28.915401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:28.916553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e38911a3-9a4c-4c7d-b7ca-f6626950601a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091029 Aug 02 09:43:28.917150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1496/3631] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:28 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:29.003006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:29.003765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:29.010375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.010814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.011587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.012020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.015917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:29.073972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:29.079527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:29.080165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:29.082745 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-845fe19a-3eae-4edf-9cf9-d90a67f564e8 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083664 Aug 02 09:43:29.083604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2136/3632] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:28 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:29.086940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.087397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.088171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.088614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.223499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:29.232150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8b4d9b90-14b4-4f74-a570-602b6d35f254 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156446 Aug 02 09:43:29.232751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1497/3633] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:29 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:29.386339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:29.386872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:29.392879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.393354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.394108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.394543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.525986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:29.534033 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-493e3130-c732-4a5b-9f0e-6502abd06548 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152034 Aug 02 09:43:29.534600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2137/3634] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:29 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:29.888159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:29.888772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:29.895253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.895699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.896451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.897034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.939823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:29.940437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:29.948089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.948530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:29.949326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:29.949761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.012460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.021191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.022774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.023908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cffa2569-dcd9-4448-af0e-2e90384c2cf0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088075 Aug 02 09:43:30.024468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2138/3635] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:29 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:30.030818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.039899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e002cc1a-db28-40a5-b785-58fedb0394c0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155617 Aug 02 09:43:30.040456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1498/3636] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:29 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:30.104747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:30.105381 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:30.111372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:30.111813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.112581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:30.113007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.174149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.182386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9f2e989f-4b5d-4125-bed0-08e1cc646602 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081563 Aug 02 09:43:30.182949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2139/3637] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:30 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:30.253761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:30.254371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:30.260886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:30.261361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.262115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:30.262546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.389751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.398165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ddc9fb3-ac67-471b-9f9d-c1944826001d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148235 Aug 02 09:43:30.398715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1499/3638] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:30 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:30.555659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:30.556277 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:30.562479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:30.562937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.563719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:30.564142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:30.696608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:30.704444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-453e3246-4ebc-41eb-ab0c-3396518f42fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153293 Aug 02 09:43:30.705008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2140/3639] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:30 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:31.047867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:31.048486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:31.055355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.055810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.056613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.057058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.061204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:31.061870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:31.068327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.068785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.069590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.070027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.120642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.129368 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.130909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.132033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-027e607b-9b3b-42a2-a8db-5f20364a808e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088106 Aug 02 09:43:31.132578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1500/3640] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:31 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:31.202165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.202965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:31.203605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:31.210427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.210785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3b6d37c6-2da3-4729-8554-142a8cecf740 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153407 Aug 02 09:43:31.210916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.211366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2141/3641] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:31 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:31.211642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.212117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.277072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.285073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-97c22c72-997e-4d20-a8ed-35100d88baa2 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086109 Aug 02 09:43:31.285681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1501/3642] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:31 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:31.419794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:31.420446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:31.426476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.426927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.427684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.428331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.554715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.562679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-46b4872e-4daf-4920-9061-1732a5e8ac75 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.146782 Aug 02 09:43:31.563253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2142/3643] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:31.725022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:31.725700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:31.731664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.732116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.732884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:31.733350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:31.860641 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:31.869317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b09a38cf-f9fa-475b-81c2-cfab8dc929f2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148229 Aug 02 09:43:31.869877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1502/3644] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:31 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:32.156868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:32.157499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:32.165874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.166320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.167106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.167619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.231590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:32.232262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:32.233376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:32.238826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.239275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.240028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.240507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.242510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:32.244031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:32.245212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1f7e6704-9271-4245-9ee2-9e6c6bc74af3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.092831 Aug 02 09:43:32.245949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2143/3645] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:32 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:32.306959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:32.307605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:32.313601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.314052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.314818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.315254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.370545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:32.376455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:32.378708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a2ba2e41-c22a-466c-bdec-9524b9d80820 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150935 Aug 02 09:43:32.379287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1503/3646] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:32 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:32.384783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-93f4bfac-6fc5-4ac5-ad2d-cf126fa755a7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081822 Aug 02 09:43:32.385367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2144/3647] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:32 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:32.584404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:32.585158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:32.591640 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.592093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.592861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.593338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.732696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:32.741251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b6b6ca0c-c115-4aee-bb7a-a8f9d8acc125 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160727 Aug 02 09:43:32.741820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1504/3648] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:32 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:32.890968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:32.891519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:32.897752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.898187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:32.898937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:32.899366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.032404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.040961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f5e2036b-77e4-42c4-b0e7-c1ffb6c9c3d6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154132 Aug 02 09:43:33.041618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2145/3649] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:32 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:33.268932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:33.269608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:33.276544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.276990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.277801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.278240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.341478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.349943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.351460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.352617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e9e2e24-a23e-4cf4-bd68-f1dd7a6b3382 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087605 Aug 02 09:43:33.353373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1505/3650] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:33 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:33.401002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:33.401671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:33.405698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:33.406310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:33.408134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.408575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.409361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.409792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.412827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.413352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.414117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.414561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.474499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.482650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-12de09a2-b88b-4bf9-b9b8-692e7089f99b tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080685 Aug 02 09:43:33.483221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1506/3651] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:33 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:33.543602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.551583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1eaee0b2-78e4-4317-9835-c45478db9bae tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155228 Aug 02 09:43:33.552164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2146/3652] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:33 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:33.763274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:33.763893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:33.769979 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.770435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.771200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:33.772230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:33.903521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:33.911594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-72d6733f-5e84-4b3d-993f-4491836f6ff4 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152159 Aug 02 09:43:33.912159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1507/3653] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:33 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:34.063678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:34.064290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:34.070942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.071386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.072145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.072576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.202779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:34.213214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b8f22f1a-7f66-47d3-a950-f9f3438e46d7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153084 Aug 02 09:43:34.214204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2147/3654] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:34 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:34.375849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:34.376436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:34.383896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.384338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.385096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.385561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.446456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:34.454725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:34.456221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:34.457371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07c1a433-25f6-43cb-9f0d-9ac3fff938a6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.085479 Aug 02 09:43:34.457926 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1508/3655] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:34 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:34.503724 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:34.504339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:34.511730 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.512180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.512940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.513404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.571795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:34.572403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:34.575688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:34.578566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.579316 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.579765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.580197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.583420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-991141d5-8321-44bc-b1b8-2fbba84b95c7 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083907 Aug 02 09:43:34.584228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2148/3656] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:34 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:34.707661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:34.715541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ab72bae9-8236-44b2-a16d-b1fc8fdec79a tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.147633 Aug 02 09:43:34.716295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1509/3657] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:34 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:34.932978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:34.933653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:34.939712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.940163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:34.940923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:34.941390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.071100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.079152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-654f4257-4f84-453f-accb-0e51f0ce35e1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150042 Aug 02 09:43:35.079727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2149/3658] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:34 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:35.235113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:35.235725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:35.242126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.242587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.243359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.243802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.375653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.385436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e73d1418-5fad-4fd3-a651-de9c8d749388 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154412 Aug 02 09:43:35.386099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1510/3659] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:35 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:35.480059 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:35.480679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:35.486792 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.487242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.488004 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.488440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.551435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.560101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.561712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.562858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-35415490-287b-4998-a66c-3ee17a7ebc39 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086756 Aug 02 09:43:35.563434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2150/3660] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:35 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:35.604940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:35.605584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:35.608875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:35.613393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.613896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.614756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.615820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.680687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.688388 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-82f9283d-56e1-4b8a-98db-1e7400347d51 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.088195 Aug 02 09:43:35.688942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1511/3661] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:35 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:35.798652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:35.799397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:35.807092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.807617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.808526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:35.809051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:35.940006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:35.948548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ba7f22e-3b6f-4798-993d-02614494e553 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154433 Aug 02 09:43:35.949133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2151/3662] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:35 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:36.101824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:36.102443 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:36.108394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.108841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.109637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.110067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.239405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:36.248009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dd0751c8-e894-4be3-bb9d-d042d49dad53 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150617 Aug 02 09:43:36.248577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1512/3663] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:36 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:36.407827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:36.408442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:36.415482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.415933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.416699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.417156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.548417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:36.551884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:36.557452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52ec21c8-e1b0-444a-b1f2-dd90ca032ab6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153616 Aug 02 09:43:36.558030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2152/3664] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:36 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:36.586160 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:36.586862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:36.593513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.593972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.594747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.595188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.599094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:36.665153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:36.673664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:36.675181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:36.676331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8f84c601-3b02-46a5-8b15-0614925f8557 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094595 Aug 02 09:43:36.676885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1513/3665] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:36 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:36.710456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:36.711083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:36.718123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.718625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.719454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.719896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.795088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:36.802813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56a5e813-4260-40fa-b239-109c231321ab tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.096749 Aug 02 09:43:36.803464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2153/3666] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:36 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:36.970121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:36.970735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:36.977531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.977983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:36.978748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:36.979184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.118222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.126184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2aa0a394-2d53-4584-b091-b0fdd9093f32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159981 Aug 02 09:43:37.126748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1514/3667] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:36 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:37.269579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:37.270193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:37.276582 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.277037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.277839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.278283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.407428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.415920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f6eb1652-2561-4b7b-b815-31f62ef5a6cb tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.150293 Aug 02 09:43:37.416491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2154/3668] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:37 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:37.578110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:37.578763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:37.584843 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.585340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.586107 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.586554 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.702161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:37.702898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:37.710208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.710661 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.711442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.711879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.722243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.731127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5a3022d2-9e35-487f-8517-f11921c4ec21 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156978 Aug 02 09:43:37.731720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1515/3669] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:37 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:37.778136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.786629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.788854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.790040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-21b96f34-ffb2-4a89-850f-fb65f7c10443 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091890 Aug 02 09:43:37.790629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2155/3670] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:37 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:37.823025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:37.823639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:37.829617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.830067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.830825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:37.831267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:37.891857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:37.899894 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7c6a56d1-1dad-402a-ab2d-495629ee04b9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.080684 Aug 02 09:43:37.900463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1516/3671] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:37 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:38.148658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:38.149322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:38.155386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.155836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.156602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.157042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.296742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:38.305141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e80d606f-e807-4dda-9809-12a8fd8d7a3c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160989 Aug 02 09:43:38.305722 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2156/3672] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:38 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:38.438031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:38.438650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:38.444632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.445088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.445881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.446324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.579781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:38.588535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-64fedb89-1b0b-453f-8b11-6f0656e34a26 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154434 Aug 02 09:43:38.589174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1517/3673] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:38 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:38.753017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:38.753678 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:38.760954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.761431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.762196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.762631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.813198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:38.813858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:38.821798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.822251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.823049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.823487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.887715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:38.894906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:38.897022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:38.898630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:38.899825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7be876a8-58b3-40c4-b2c5-1aa39a3eed1c tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090647 Aug 02 09:43:38.900379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1518/3674] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:38 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:38.903901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0c6fa9fc-44b7-41ab-9cda-eeefdbccbf58 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154733 Aug 02 09:43:38.904671 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2157/3675] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:38 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:38.921568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:38.922027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:38.928243 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.928724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.929518 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:38.929959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:38.994097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:39.001516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d173f7b5-9475-42e0-aae9-0ba5523e67a0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083928 Aug 02 09:43:39.002077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1519/3676] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:38 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:39.326346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:39.326986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:39.333232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.333739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.334518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.334954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.468286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:39.477037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-df27a1e7-6b3f-45c6-a9ea-6c73abca21c1 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154637 Aug 02 09:43:39.477650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2158/3677] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:39 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:39.610525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:39.611070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:39.618117 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.618575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.619346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.619788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.747328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:39.755216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-deea6a09-e4d0-4348-8d93-5ef44f5b16da tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148705 Aug 02 09:43:39.756165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1520/3678] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:39 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:39.922977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:39.923602 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:39.925973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:39.926663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:39.931294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.931747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.932521 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.932964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.934178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.934721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.935663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:39.936187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:39.996882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.005906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.007455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.008889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9170b975-0650-48dc-a518-d4c96166fc6f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090099 Aug 02 09:43:40.009482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2159/3679] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:39 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:40.022728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:40.023344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:40.030346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:40.030885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:40.031828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:40.032322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:40.081851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.091853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-36ceeb36-575e-49c2-ae27-5d09dfca7514 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.170738 Aug 02 09:43:40.092493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1521/3680] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:39 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:40.103919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.108305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6c173df3-0927-451f-b822-13bcdcfaa4ca tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.090089 Aug 02 09:43:40.108886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2160/3681] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:40 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:40.499070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:40.499685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:40.506256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:40.506712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:40.507479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:40.508184 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:40.641783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.651033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c77bf6d5-e803-432e-b5e6-5836c9205b7d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155936 Aug 02 09:43:40.651694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1522/3682] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:40 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:40.777686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:40.778307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:40.784480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:40.784932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:40.785740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:40.786180 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:40.931768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:40.939725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-79087b1f-9497-42b7-81c0-ad75bee89405 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.166283 Aug 02 09:43:40.940283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2161/3683] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:40 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:41.032098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:41.032659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:41.039708 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.040161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.040919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.041390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.104087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:41.112862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:41.114423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:41.116095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:41.116327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5ea8b95d-48ab-42d0-80ef-e9c6f9898453 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088140 Aug 02 09:43:41.116786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:41.116910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1523/3684] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:41 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:41.123426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.123970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.124706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.125269 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.128869 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:41.129520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:41.136052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.136517 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.137331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.137893 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.199998 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:41.207566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-33437ef2-e406-4e14-a566-f521a9a5ee33 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082563 Aug 02 09:43:41.208138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1524/3685] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:41 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:41.267153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:41.275885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dd5748da-4ad5-4d4c-949f-9fe7de88b57b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.164944 Aug 02 09:43:41.276812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2162/3686] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:41 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:41.674848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:41.675469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:41.681749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.682205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.682978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.683420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.823671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:41.831580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a82e9d38-8774-4fa8-bd21-56938732d964 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160754 Aug 02 09:43:41.832146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1525/3687] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:41 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:41.961908 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:41.962468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:41.968956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.969542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:41.970316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:41.970755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.107825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:42.117396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d42488a9-c8e1-44f4-bb87-e326efac7715 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160372 Aug 02 09:43:42.117974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2163/3688] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:41 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:42.139752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:42.140364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:42.146902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.147352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.148114 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.148559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.210776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:42.219493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:42.220734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:42.221919 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0b9fb443-5450-4b5d-8543-6903cc0733d6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086150 Aug 02 09:43:42.222671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1526/3689] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:42 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:42.228774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:42.229589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:42.236213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.236652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.237510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.237942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.300826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:42.301495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:42.303353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:42.307901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.308355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.309150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.309595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.311230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-05eebb6d-c2b5-41a5-8c12-407de633eb00 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087152 Aug 02 09:43:42.312032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2164/3690] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:42 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:42.448149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:42.456484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cac84904-a09d-4a58-a223-735c26d33d4b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159715 Aug 02 09:43:42.457057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1527/3691] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:42 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:42.853921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:42.854533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:42.860631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.861085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.861885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:42.862327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:42.992629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.000637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-11c48e9e-e0ef-4ac1-ab3c-e5a297106945 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.150680 Aug 02 09:43:43.001229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2165/3692] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:42 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:43.138952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:43.139523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:43.146504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.147069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.147842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.148287 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.245885 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:43.246507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:43.252578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.253028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.253862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.254298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.278992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.287605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-052596ac-e576-4106-b993-a4b9830fdaab tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152632 Aug 02 09:43:43.288311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1528/3693] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:43 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:43.316746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.325911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.327530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.328772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52994815-fbb9-4920-bdf6-ea814328f9ba tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.086818 Aug 02 09:43:43.329514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2166/3694] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:43.333224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:43.333927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:43.340122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.340653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.341523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.342052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.403390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.406747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:43.412090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b560c55d-a0fe-4589-a2de-588534f6c851 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082503 Aug 02 09:43:43.412679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1529/3695] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:43 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:43.480861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:43.481512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:43.487610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.488064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.488829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:43.489307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:43.621839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:43.629884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1aaab14c-582d-438f-a176-8f4236274bb6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152887 Aug 02 09:43:43.630461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2167/3696] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:44.022735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:44.023355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:44.029669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.030128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.030903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.031345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.164836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.174073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3650e7d4-d419-4d1a-90b8-9507eb7a75b8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.155756 Aug 02 09:43:44.174586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1530/3697] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:44 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:44.309769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:44.310383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:44.316913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.317404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.318917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.319359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.352137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:44.352742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:44.358878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.359323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.360090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.360523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.424870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.435942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.437487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.438674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2aee6f88-2474-4d16-ab0c-77ca6f5de7f3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090765 Aug 02 09:43:44.439270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1531/3698] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:44 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:44.444405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:44.445022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:44.450988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.451445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.452224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.452664 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.453696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.463179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5d74decc-00f6-4ea7-ad9b-23547fb2c59b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157223 Aug 02 09:43:44.463859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2168/3699] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:44 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:44.514204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.521927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e7a5757-dde7-4f54-b50e-b5c1e4ef9ebf tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081539 Aug 02 09:43:44.522503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1532/3700] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:44 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:44.651119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:44.651772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:44.657926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.658376 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.659147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:44.659586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:44.679740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:44.795416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:44.804334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f42adafa-f463-41bd-8804-626d4b97110d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157176 Aug 02 09:43:44.804912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2169/3701] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:44 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:45.195605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:45.196213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:45.202739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.203197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.203961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.204403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.346643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.355169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-601f5952-1382-4d7a-ba0f-d20e5887c266 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.163501 Aug 02 09:43:45.355737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1533/3702] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:45 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:45.462152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:45.462684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:45.469278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.469727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.470486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.470919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.484621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:45.485271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:45.491891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.492348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.493143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.493592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.538836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.547411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.548931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.550134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-67622101-3907-4101-9ea5-c375e82cf911 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091995 Aug 02 09:43:45.550699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2170/3703] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:45 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:45.555967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:45.556588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:45.559440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:45.564045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.564501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.565309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.565761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.626348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.629648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.634879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47934f6d-1e9a-48f5-9f54-a1803d0266e5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154203 Aug 02 09:43:45.635548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1534/3704] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:45 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:45.637491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ff316b94-f9c4-41f9-b47a-af8df80f19de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.085753 Aug 02 09:43:45.638055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2171/3705] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:45 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:45.825912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:45.826534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:45.832501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.832956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.834281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:45.834720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:45.964536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:45.972559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a9708362-eb52-4fb3-9b87-bd53997751c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150611 Aug 02 09:43:45.973133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1535/3706] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:46.376031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:46.376675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:46.383766 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.384216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.384983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.385459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.525387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:46.533568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8af57f3f-a3d2-4df8-98a4-ade2e283a930 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.161564 Aug 02 09:43:46.534147 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2172/3707] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:46 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:46.574213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:46.574826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:46.581328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.581786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.582549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.582988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.651063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:46.656556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:46.657299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:46.660051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:46.662185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:46.663369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-63b217bb-81d8-49d5-8f9c-a0a4a1e29ec5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093194 Aug 02 09:43:46.663938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1536/3708] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:46 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:46.664647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.665168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.666080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.666558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.668252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:46.668861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:46.674648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.675101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.675866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:46.676299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:46.739829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:46.747423 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8a2dd7e1-cdfc-4371-9ac2-66e1b07a70de tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082507 Aug 02 09:43:46.747997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1537/3709] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:46 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:46.804401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:46.812455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d11b5ab1-a576-4583-b9c4-54ec089ef33e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.160376 Aug 02 09:43:46.813035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2173/3710] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:46 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:46.994116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:46.994729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:47.000726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.001204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.001969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.002408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.132900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.140826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e1de8531-03bb-4464-9b82-fcf58fd27bc7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151061 Aug 02 09:43:47.141417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1538/3711] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:46 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:47.556042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:47.556656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:47.563242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.563695 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.564457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.564896 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.687523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:47.688132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:47.694743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.695197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.695887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.696045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.696398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.703956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ad9aaee6-6d98-4eab-9b64-b40307dbdf96 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.152497 Aug 02 09:43:47.704540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2174/3712] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:47 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:47.760099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.767775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:47.768405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:47.768590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.770141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.771344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-185b13c1-5c7d-40b7-904b-d738d5e35669 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.087794 Aug 02 09:43:47.771899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1539/3713] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:47 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:47.774713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.775166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.775936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.776375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.835367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:47.835911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:47.841458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.842832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.843347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.844165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:47.844655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:47.850479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-983a355d-02fb-4a67-b64b-b08507c695b0 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086529 Aug 02 09:43:47.851067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2175/3714] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:47 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:47.980901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:47.988980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-99fcfb7e-1620-4ce7-a577-a1281ba43265 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.157620 Aug 02 09:43:47.989599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1540/3715] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:47 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:48.164096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:48.164645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:48.170802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.171246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.172003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.172434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.304340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:48.312367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32210243-679b-4e7d-b13f-887a30cbe599 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153463 Aug 02 09:43:48.312938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2176/3716] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:48 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:48.726377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:48.726975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:48.733449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.733907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.734673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.735120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.794904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:48.795517 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:48.802423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.802868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.803723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.804178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.870033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:48.874394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:48.879410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3522938c-3e68-44c6-a0cf-067ea5bc7db9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.157581 Aug 02 09:43:48.880414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1541/3717] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:48 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:48.885147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:48.885787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:48.888036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:48.889955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:48.891264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8c4fa23-5008-41a7-836e-f04cf631663b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.100423 Aug 02 09:43:48.892952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2177/3718] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:48 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:48.894444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.895034 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.896466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:48.897373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:48.967451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:48.975977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a6d2a5f7-2aa7-4940-abbe-570eb7c0f417 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.094958 Aug 02 09:43:48.976815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1542/3719] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:48 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:49.011221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:49.011842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:49.017931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.018386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.019153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.019593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.157742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:49.166157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-04ca8b46-b778-4a86-9e27-52160ad517b3 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.159110 Aug 02 09:43:49.166729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2178/3720] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:49 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:49.335669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:49.336291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:49.342358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.342810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.343569 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.344004 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.474622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:49.482571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-86605e24-b08d-40de-b7cf-86c4df245490 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152764 Aug 02 09:43:49.483133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1543/3721] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:49 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:49.902077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:49.902698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:49.910010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.910479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.911858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.912412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.916597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:49.917258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:49.923908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.924363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.925162 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:49.925605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:49.994477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.003620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.005339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.006551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dfe908ad-f5e7-46e4-b58e-a5bb618fd9c1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093874 Aug 02 09:43:50.007092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1544/3722] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:49 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:50.012074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:50.012695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:50.019397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:50.019866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:50.020635 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:50.021551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:50.047708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.057752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a9e8d90d-70f1-4b57-931f-20e54e1f038f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.159877 Aug 02 09:43:50.058447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2179/3723] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:49 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:50.082018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.089796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-100f0876-e574-4130-a21e-3d22a6f6bfb9 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.081425 Aug 02 09:43:50.090292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1545/3724] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:50 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:50.189198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:50.189812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:50.196211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:50.196654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:50.197436 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:50.197871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:50.330609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.340280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-59fcbb5f-9279-42d6-85d2-fa3f34d7df8f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.154970 Aug 02 09:43:50.340920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2180/3725] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:50 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:50.504783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:50.505555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:50.512740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:50.513304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:50.514176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:50.514686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:50.535298 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:50.652601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:50.660599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-892ddc0a-be95-4e5c-810c-223a9d185a7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160568 Aug 02 09:43:50.661189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1546/3726] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:51.031939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:51.032559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:51.039207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.039660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.040432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.040870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.079829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:51.080472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:51.087461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.087915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.088690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.089147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.107111 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.116153 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.117689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.118839 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e48dabca-4b47-446d-b53a-9aa2f7510cdd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090931 Aug 02 09:43:51.119403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2181/3727] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:51 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:51.125913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:51.125913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:51.130596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.131591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.132354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.133044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.195721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.203297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b72fe2fa-7894-45e1-b95d-b877061ffac5 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.082858 Aug 02 09:43:51.204115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2182/3728] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:51 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:51.231469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.241970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-371b96b9-5ec5-4394-9229-3d6eb3ee09e8 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.165921 Aug 02 09:43:51.242531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1547/3729] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:51 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:51.363951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:51.365262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:51.371487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.371939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.372702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.373179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.501238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.509806 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-deff0384-2068-4300-8630-559c43f35a9b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.149740 Aug 02 09:43:51.510387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2183/3730] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:51 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:51.682535 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:51.683146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:51.689071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.689546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.690300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:51.690736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:51.821637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:51.829530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94c3f301-6e87-4961-9234-f59992c388aa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150907 Aug 02 09:43:51.830099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1548/3731] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:52.142871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:52.143429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:52.150679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.151133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.151900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.152339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.218237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:52.224492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:52.225225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:52.226914 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:52.228502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:52.229611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a84425cb-fcb4-4df1-abf3-51ff53d67597 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090832 Aug 02 09:43:52.230179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2184/3732] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:52 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:52.232020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.232564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.233439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.233878 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.263607 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:52.264263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:52.270382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.271431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.272203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.272639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.296796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:52.305091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-db771976-5d2f-4597-9b40-84b6d3ad93a1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084445 Aug 02 09:43:52.305722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1549/3733] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:52 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:52.405061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:52.413065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5231c7d3-fa0a-4283-a714-a63b757c021b tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.153267 Aug 02 09:43:52.413664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2185/3734] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:52 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:52.531479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:52.532120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:52.538873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.539327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.540088 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.540527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.667836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:52.675936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-41fa1107-915e-49f6-baa3-9ba12212488e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.148528 Aug 02 09:43:52.676506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1550/3735] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:52 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:52.851710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:52.852360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:52.858515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.858965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.859732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:52.860177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:52.864190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:53.002926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.011748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3f9e85b-f782-4fe9-8047-92e6f7457d0f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.164333 Aug 02 09:43:53.012520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2186/3736] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:52 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:53.253178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:53.253801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:53.260593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.261045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.261833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.262272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.327259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:53.327909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:53.328835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.335510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.335958 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.336733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.337207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.338192 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.339702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.340857 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6ddff013-33b8-4b30-a1ef-22253d875710 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.091641 Aug 02 09:43:53.341444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1551/3737] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:53 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:53.402583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.410319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2bf44f52-e5df-40b4-82a8-517ba59a8d0e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.087014 Aug 02 09:43:53.410901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2187/3738] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:53 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:53.434231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:53.434846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:53.440820 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.441314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.442078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.442676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.571688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.579599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d6112f1-ae53-477f-81f9-eb466fc251a0 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.149265 Aug 02 09:43:53.580159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1552/3739] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:53 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:53.698064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:53.698684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:53.704668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.705139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.705916 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:53.706354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:53.839015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:53.846950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30213489-afa9-4553-aba7-048b766ae43b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.152782 Aug 02 09:43:53.847713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2188/3740] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:53 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:54.033321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:54.033939 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:54.040374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.040835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.041622 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.042060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.170996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:54.179533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e33fb2b8-037f-4a21-9043-50578c06bb9a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150434 Aug 02 09:43:54.180099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1553/3741] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:54.365065 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:54.365668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:54.372117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.372568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.373486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.373928 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.433221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:54.433952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:54.437284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:54.440805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.441293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.442070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.442598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.446182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:54.447699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:54.448857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f65338ae-6c0d-4584-baa2-f57862ee0efa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.088362 Aug 02 09:43:54.449464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2189/3742] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:54 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:54.511360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:54.518798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d12460b1-ae7d-4e51-af1d-c0b6749d893d tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.089588 Aug 02 09:43:54.519361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1554/3743] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:54 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:54.646606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:54.647233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:54.653264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.653719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.654486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.654929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.788138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:54.796088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-612851f4-8d6e-4a47-98ac-070931f6dce7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.198868 Aug 02 09:43:54.796654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2190/3744] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:54 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:54.913811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:54.914435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:54.920699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.920995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:54.921804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:54.922245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.056469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.065132 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1704b467-84ec-44f8-936c-9ec0a3d696ce tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.201892 Aug 02 09:43:55.065771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1555/3745] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:54 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:55.200743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:55.201316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:55.207473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.207923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.209303 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.209743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.337737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.345706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-05f6d5d2-45c3-4f3c-bfe8-a67f0ad1f009 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148989 Aug 02 09:43:55.346275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2191/3746] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:55 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:55.539634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:55.540280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:55.546549 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:55.547011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.547171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:55.547300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.548046 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.548487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.553912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.554369 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.555144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.555582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.611522 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.619792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.620037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2685d143-2f94-4be3-b467-78dc1f8f7909 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084441 Aug 02 09:43:55.620482 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2192/3747] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:55 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:55.628667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.630902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.632128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a058c0ee-00c7-4723-a8b1-60a3332fac1d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.163038 Aug 02 09:43:55.633016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1556/3748] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:55 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:55.819955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:55.820712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:55.827427 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.827951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.828756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:55.829307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:55.966162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:55.975673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fdf9cd96-7569-4312-8842-4d5f7a7613e9 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160685 Aug 02 09:43:55.976339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2193/3749] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:55 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:56.088479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:56.089134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:56.095763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.096231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.097167 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.097636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.233588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:56.242270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d22b67de-f540-4e7e-9b13-3f1abdf6889a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158190 Aug 02 09:43:56.242852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1557/3750] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:56 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:56.366788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:56.367362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:56.373604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.374051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.374819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.375263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.504957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:56.513452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-61701324-e201-43f0-9567-1d026d41c3ea tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150604 Aug 02 09:43:56.514052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2194/3751] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:56 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:56.642485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:56.643015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:56.650590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.651069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.651891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.652371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.655279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:56.655901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:56.662211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.662662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.663435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:56.663877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:56.716900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:56.725456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c84706fc-3cd8-4786-b9ca-4fffe5ad2fff tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.086542 Aug 02 09:43:56.725456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1558/3752] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:56 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:56.727826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:56.742556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:56.744221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:56.745623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-637443cb-1ddf-4aa5-a893-832fe47f72ae tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.094317 Aug 02 09:43:56.746385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2195/3753] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:56 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:43:56.998915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:56.999531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:57.005840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.006323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.008065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.008733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.147089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.155036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c5d720c-77f2-42c1-8ca9-d4220ec0c43f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.160084 Aug 02 09:43:57.155655 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1559/3754] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:56 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:57.265471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:57.266089 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:57.272084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.272530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.273324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.273762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.412307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.420426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8a20d3cd-7249-4620-948f-1300a3258159 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.158884 Aug 02 09:43:57.420997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2196/3755] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:57 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:57.535495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:57.536525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:57.542566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.543018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.543772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.544206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.745656 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:57.746296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:57.752650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.753121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.753936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.754377 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.818732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.826559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7efd9114-b6d3-45f8-97a1-c9164bedda9c tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.084848 Aug 02 09:43:57.827146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2197/3756] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:57 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:57.831668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:57.832279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:57.838924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.839380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.840156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:57.840596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:57.905438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.915352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.916912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.918486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3a6c850a-6559-4a22-b31e-369003bec194 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.090402 Aug 02 09:43:57.919305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2198/3757] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:57 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:57.935397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:57.944604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eedcef24-3d04-4b0a-ab09-79b944286e4f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.412836 Aug 02 09:43:57.945992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1560/3758] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:57 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:58.176548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:58.177892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:58.184076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.184528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.185347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.185782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.318557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:58.327209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ae8388e8-7721-4384-896a-4ba387356835 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.154671 Aug 02 09:43:58.327857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2199/3759] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:58 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:58.444008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:58.444652 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:58.447874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:58.452476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.452940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.453752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.454189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.586501 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:58.595127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5e0c894b-f325-4b87-8e69-2fcc1573f887 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.156299 Aug 02 09:43:58.595801 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1561/3760] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:58 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:58.847795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:58.848448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:58.855900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.856355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.857141 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.857588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.919710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:58.927708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c52317d7-3512-4142-a652-5871d04b15a3 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.083787 Aug 02 09:43:58.928281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2200/3761] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:58 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:58.940959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:58.941627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:58.948650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.949097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.949927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.950372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.967705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:58.968320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:58.974743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.975200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:58.975977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:58.976415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.017611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:59.027662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:59.029268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:59.030427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cb631bd7-2ef6-4ea7-8610-63f1867429b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 200 len: 1449 microversion: 2.20 time: 0.093377 Aug 02 09:43:59.030984 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1562/3762] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:43:58 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 1449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:43:59.054177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88e7365e-eebc-426c-b9b3-489e0f9341f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '.version_select at 0x7f8c181f3040>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:59.078963 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88e7365e-eebc-426c-b9b3-489e0f9341f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158862248" status: 204 len: 0 microversion: 2.20 time: 0.028876 Aug 02 09:43:59.079759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1563/3763] 10.222.0.100 () {60 vars in 1267 bytes} [Tue Aug 2 09:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158862248 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 09:43:59.116103 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:59.124210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ebbc122-8606-46f5-a148-1f654a2ed134 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160314 Aug 02 09:43:59.124793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2201/3764] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:58 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:43:59.351623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:59.352285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:59.358722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:59.359175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.359954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:59.360394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.365289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:59.557526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:59.565478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-784f6113-3d91-40d1-9939-f96b70cf5b08 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.218022 Aug 02 09:43:59.566055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1564/3765] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:59 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:59.619835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:59.620372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:59.626412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:59.626863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.627631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:59.628074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.772064 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:43:59.775807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:43:59.780927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3046be22-3031-451a-bee2-01477285bd7c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.165038 Aug 02 09:43:59.781561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2202/3766] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:59 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:43:59.948662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:43:59.949588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] [instance: 64272d61-0647-41fa-960d-d71df9c72c70] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:43:59.952195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6e95b8e3-f554-475d-9388-72b219656469 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'create', calling method: .version_select at 0x7f8c181019d0>, body: {"keypair": {"name": "tempest-keypair-1998615020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC+2EQ/y7Oi+wkYXnrB8uGphqOxcGYoGN+AemO3JAvcyhkOiSLwsNKOKdy2ns5haDQTMGrNKa/Qsho7MF07n7RTojGpaYFipZGu3671mlipCJ7OmLwAqJQk3twbcjLPUw=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:43:59.957104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:59.957632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.958565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:43:59.959484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:43:59.971564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-6e95b8e3-f554-475d-9388-72b219656469 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:43:59.976130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-6e95b8e3-f554-475d-9388-72b219656469 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for user 0e93d159e8644203808918c5ae86fc74 and project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:44:00.001849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6e95b8e3-f554-475d-9388-72b219656469 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053517 Aug 02 09:44:00.002478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2203/3767] 10.222.0.100 () {62 vars in 1205 bytes} [Tue Aug 2 09:43:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 09:44:00.037754 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e5fb6488d4478b8f4449295613e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dd8f336ea44f14bfaf1c127ddbacb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:00.046225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-660a9b51-2fce-47d1-84c9-0ad395144ac1 tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70" status: 200 len: 1223 microversion: 2.1 time: 0.101842 Aug 02 09:44:00.047205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1565/3768] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:43:59 2022] GET /compute/v2.1/servers/64272d61-0647-41fa-960d-d71df9c72c70 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:00.150299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:00.151148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:00.157858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:00.158588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:00.159566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:00.160011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:00.241502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-38367b8d-5802-408b-9dfe-e62a0000f08e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] Calling method '.version_select at 0x7f8c18348d30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:00.265236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-38367b8d-5802-408b-9dfe-e62a0000f08e tempest-TestShelveInstance-223709517 tempest-TestShelveInstance-223709517-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1502777233" status: 202 len: 0 microversion: 2.1 time: 0.028318 Aug 02 09:44:00.266557 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1566/3769] 10.222.0.100 () {58 vars in 1259 bytes} [Tue Aug 2 09:44:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1502777233 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:44:00.378309 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:00.391306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2294ee17-2702-40db-9ac9-930dabd09861 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.248882 Aug 02 09:44:00.391981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2204/3770] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:00 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:00.590075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:00.590917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:00.600612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:00.601381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:00.602400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:00.602835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:00.803668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:00.804686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:00.811512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:00.812084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:00.813011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:00.813596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:00.941987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:00.951981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cba5662c-bc97-4e3e-b33f-33f019a58426 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.367832 Aug 02 09:44:00.956326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:00.963207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1567/3771] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:00 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:00.965013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-283f91eb-8136-4e6a-b7ea-7241e3ac4560 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.165996 Aug 02 09:44:00.965823 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2205/3772] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:00 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:01.414647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:01.415293 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:01.421302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:01.421756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:01.422520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:01.422962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:01.761615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:01.769704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c8bed803-df15-4aa7-b597-6c54fd3dc820 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.359446 Aug 02 09:44:01.770930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1568/3773] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:01 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:01.974990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:01.975608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:01.982634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:01.983106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:01.984008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:01.984451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:01.986757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:01.987374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:01.993338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:01.994005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:01.994780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:01.995213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:02.125876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:02.135401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-90ba1134-1089-4de0-b259-e70ab8625bd7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.164739 Aug 02 09:44:02.136114 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2206/3774] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:01 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:02.565881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:02.574607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2fc2db34-d9ee-4dc3-bc1c-ca1385f3dd3b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.591800 Aug 02 09:44:02.575204 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1569/3775] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:01 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:44:02.708757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1417345247", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73cc5faf-794f-47fb-bcca-7a930b56333e"}], "security_groups": [{"name": "tempest-securitygroup--2102105442"}], "key_name": "tempest-keypair-1998615020", "user_data": "}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:02.793728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:02.794756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:02.814901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:02.815354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:02.816274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:02.816572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:02.874054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] validate_networks() for [('73cc5faf-794f-47fb-bcca-7a930b56333e', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:44:03.093484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:03.105751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95da0e5f-4095-4041-b331-3b5fc361b045 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.316617 Aug 02 09:44:03.106648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1570/3776] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:02 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:03.157838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:03.158457 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:03.165196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:03.165575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:03.166343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:03.166971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:03.335481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:44:03.335979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:44:03.336385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:44:03.336793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:44:03.337380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:44:03.346220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:03.346673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:03.347487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:03.347934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:03.365266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:44:03.369334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Getting quotas for user 0e93d159e8644203808918c5ae86fc74 and project ada46409d8ae4abfaf19056675f7fbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:44:03.381300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:44:03.383857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:44:03.392573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:03.417817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40c158e1-fc71-4b85-98b7-f4a7bd967e32 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.262827 Aug 02 09:44:03.433236 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1571/3777] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:03 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:03.438231 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd902f2e-4a6b-4787-8964-0c7d047504f1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.734196 Aug 02 09:44:03.446124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2207/3778] 10.222.0.100 () {62 vars in 1193 bytes} [Tue Aug 2 09:44:02 2022] POST /compute/v2.1/servers => generated 404 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 09:44:03.451917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07994fbd-8979-4d09-89bc-09bf6a144932 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:03.452938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-07994fbd-8979-4d09-89bc-09bf6a144932 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:03.522542 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07994fbd-8979-4d09-89bc-09bf6a144932 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:03.531771 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07994fbd-8979-4d09-89bc-09bf6a144932 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:03.534597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-07994fbd-8979-4d09-89bc-09bf6a144932 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:03.539341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07994fbd-8979-4d09-89bc-09bf6a144932 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1286 microversion: 2.20 time: 0.091802 Aug 02 09:44:03.540550 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1572/3779] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:03 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:44:03.600741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:03.602176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:03.606930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:03.616272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:03.616742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:03.617795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:03.618230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:03.894356 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:03.910313 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9c83c09a-2591-4616-9d6c-16c53bd3ef90 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.316366 Aug 02 09:44:03.911921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2208/3780] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:03 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:04.129037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:04.130726 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:04.139103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.139563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.140490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.140944 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.299420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:04.308247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f3b33f96-3fce-422b-85f1-3b2c42baf0ab tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.183092 Aug 02 09:44:04.308952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1573/3781] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:04 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:04.441801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:04.442384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:04.449209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.449659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.450485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.450923 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.565841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:04.566757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:04.574226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.575044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.576252 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.576768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.659653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:04.670829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:04.672623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:04.673961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2276de83-174f-41dc-9733-20c482127bef tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1346 microversion: 2.20 time: 0.112766 Aug 02 09:44:04.675015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1574/3782] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:04 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:44:04.694184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:04.705212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f734fbd6-a9df-435d-ac38-1b526af82624 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.267272 Aug 02 09:44:04.705846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2209/3783] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:04 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:04.932511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:04.933174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:04.939142 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.939597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:04.940373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:04.940813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.263155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:05.276607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4c027696-6ca3-4769-b6eb-844cc6f86ca0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.348032 Aug 02 09:44:05.279045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1575/3784] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:04 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:05.339508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:05.342601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:05.355636 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:05.356086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.357040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:05.357565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.595019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:05.606466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69bbb28f-c40a-4caf-aa68-d49bfda35b99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.278390 Aug 02 09:44:05.608165 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2210/3785] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:05 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:05.700346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:05.701281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:05.712736 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:05.713538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.715197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:05.716896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.732361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:05.732931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:05.740363 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:05.741026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.742240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:05.742851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:05.991682 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:05.993787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:06.001307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:06.006118 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:06.006638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-066a728a-f563-4432-b010-4deb3039ea86 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.277613 Aug 02 09:44:06.008534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bdd87aea-0fb7-466f-97df-feae5a1d50d0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.311704 Aug 02 09:44:06.009632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1576/3787] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:05 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:44:06.013202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2211/3787] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:05 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:44:06.299494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:06.300545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:06.310510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:06.311188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:06.312232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:06.312752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:06.534484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:06.547775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-938d2e85-e8d6-4d51-9182-df6a541f20e9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.252050 Aug 02 09:44:06.560409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1577/3788] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:06 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:06.632276 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:06.633380 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:06.639971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:06.640465 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:06.641308 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:06.641955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:06.693828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-b4aacffb-a04f-48c4-8c7c-a680f3bebb8f req-bafe417d-1736-4495-b284-f036381aefee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:06.704789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b4aacffb-a04f-48c4-8c7c-a680f3bebb8f req-bafe417d-1736-4495-b284-f036381aefee service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:06.705512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b4aacffb-a04f-48c4-8c7c-a680f3bebb8f req-bafe417d-1736-4495-b284-f036381aefee service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:06.720537 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-b4aacffb-a04f-48c4-8c7c-a680f3bebb8f req-bafe417d-1736-4495-b284-f036381aefee service nova] Creating event network-changed:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:44:06.730574 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-b4aacffb-a04f-48c4-8c7c-a680f3bebb8f req-bafe417d-1736-4495-b284-f036381aefee service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107281 Aug 02 09:44:06.732909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2212/3789] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:06.890208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:06.900921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-96095e5f-f0da-4828-a987-9938699643be tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.274647 Aug 02 09:44:06.911852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1578/3790] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:06 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:44:07.035311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:07.036753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:07.037427 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:07.040651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:07.045104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.045823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.046864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.047477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.052977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.055096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.055096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.061438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.283074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:07.291693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:07.293873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:07.295002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c0396add-a100-485c-a180-ec3f5736c9b2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.264436 Aug 02 09:44:07.299625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1579/3791] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:07 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:44:07.321343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:07.329260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-918501b8-ae92-4fa4-8b1a-c8e47eeb0c2d tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.302932 Aug 02 09:44:07.329838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2213/3792] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:07 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:07.570036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:07.570680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:07.577222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.577686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.578466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.578900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.720096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:07.728906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-090d9fd5-290b-49c3-b286-be7ae2140dbc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.163012 Aug 02 09:44:07.737685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1580/3793] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:07 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:07.923912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:07.924304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:07.932705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.933263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:07.934325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:07.934762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:08.322312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:08.323626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:08.330179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:08.330927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:08.331908 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:08.332662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:08.378753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:08.388881 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5268a470-9a07-453c-9368-0c2e1d63d358 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.470240 Aug 02 09:44:08.389639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2214/3794] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:07 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:08.402446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:08.403449 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 653f50f6-3df3-4a7a-baef-b1222520a28f] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:08.411322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:08.411769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:08.412549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:08.413495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:08.578348 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:08.589129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:08.591195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:08.592897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-174e4878-92c8-4795-af44-fd5cc2dcacee tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.276812 Aug 02 09:44:08.594076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1581/3795] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:08 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:44:08.700620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:08.709542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8014bb1e-6d59-4761-8e75-223b11296545 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f" status: 200 len: 1738 microversion: 2.1 time: 0.318294 Aug 02 09:44:08.710043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2215/3796] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:08 2022] GET /compute/v2.1/servers/653f50f6-3df3-4a7a-baef-b1222520a28f => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:08.731527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f56ac805-011e-4b65-b45a-0b6e2b71e0ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '.version_select at 0x7f8c1c18a790>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:08.764003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f56ac805-011e-4b65-b45a-0b6e2b71e0ec tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-303963766" status: 202 len: 0 microversion: 2.1 time: 0.025823 Aug 02 09:44:08.764003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1582/3797] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-303963766 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:44:08.764271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:08.764271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:08.771078 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:08.771648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:08.772642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:08.773218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:09.149083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:09.157347 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e12d0321-af7a-4d42-89a2-6cde47bef50b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 200 len: 1730 microversion: 2.1 time: 0.411058 Aug 02 09:44:09.157932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2216/3798] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:08 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 1730 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:09.181253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c4a0a82a-d472-4469-9ccd-b7f757039523 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '.version_select at 0x7f8c181f3ee0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:09.202748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c4a0a82a-d472-4469-9ccd-b7f757039523 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632376403" status: 202 len: 0 microversion: 2.1 time: 0.025494 Aug 02 09:44:09.203403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1583/3799] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632376403 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:44:09.410601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:09.411633 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:09.419290 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:09.419857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:09.421155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:09.421686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:09.619451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:09.620753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:09.631214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:09.642480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-606c4ead-6304-473c-b24c-080c86445e99 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.235956 Aug 02 09:44:09.645764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:09.659876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2217/3800] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:09 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:09.660762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:09.662431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:09.663159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:09.980078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:09.987827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:09.995354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:09.996868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:09.998248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e7dac11f-a414-4765-9d6b-ccfdb2730228 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.383772 Aug 02 09:44:09.998982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1584/3801] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:09 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:44:10.275754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-e830eeda-d61a-4474-a954-d17f11b7f7cd req-59e603a1-f96d-4fb9-8a68-818f850186b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:10.290603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-e830eeda-d61a-4474-a954-d17f11b7f7cd req-59e603a1-f96d-4fb9-8a68-818f850186b4 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:10.291345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-e830eeda-d61a-4474-a954-d17f11b7f7cd req-59e603a1-f96d-4fb9-8a68-818f850186b4 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:10.304705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-e830eeda-d61a-4474-a954-d17f11b7f7cd req-59e603a1-f96d-4fb9-8a68-818f850186b4 service nova] Creating event network-changed:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:44:10.310634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-e830eeda-d61a-4474-a954-d17f11b7f7cd req-59e603a1-f96d-4fb9-8a68-818f850186b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103089 Aug 02 09:44:10.311387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2218/3802] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:10.672553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:10.674300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:10.689422 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:10.690942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:10.693567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:10.694323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:11.024893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:11.025940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:11.039271 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:11.040768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:11.044175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:11.045437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:11.226103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:11.236912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5ac99523-9403-42a7-b58b-46b25518347d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.569324 Aug 02 09:44:11.252627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1585/3803] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:10 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:11.253406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:11.263337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:11.265970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:11.271241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eca3215a-e313-4099-b9c1-02059f4d9727 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.250735 Aug 02 09:44:11.271843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2219/3804] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:11 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:44:11.422051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-f08c770a-f92c-4e62-92e5-53156c467920 req-497c7d95-8c2c-4b9f-a8dc-00e950cb4918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e2d9a6-78b8-4f7a-8216-490f423ba511", "tag": "817289ba-4f88-470b-aec4-8eae8997d6ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:11.444654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-f08c770a-f92c-4e62-92e5-53156c467920 req-497c7d95-8c2c-4b9f-a8dc-00e950cb4918 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:11.445863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-f08c770a-f92c-4e62-92e5-53156c467920 req-497c7d95-8c2c-4b9f-a8dc-00e950cb4918 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:11.479437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-f08c770a-f92c-4e62-92e5-53156c467920 req-497c7d95-8c2c-4b9f-a8dc-00e950cb4918 service nova] Creating event network-changed:817289ba-4f88-470b-aec4-8eae8997d6ce for instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 on hv-cinder-80382 Aug 02 09:44:11.494996 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-f08c770a-f92c-4e62-92e5-53156c467920 req-497c7d95-8c2c-4b9f-a8dc-00e950cb4918 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081431 Aug 02 09:44:11.499623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1586/3805] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:11.649071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4d79ff89-226b-49b3-98ee-9512c7e3d86a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: .version_select at 0x7f8c18101dc0>, body: {"keypair": {"name": "tempest-keypair-349233501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpLN/1WjHQiOAb6UGO8/EquwUHKwuj2WlAew05wXooQXW7MEUqPbILSMmJaMPw3Xv1fhGXylNppPZDfPrFb8yYASVFBe3XkLGb1WIjnryEk6xfXHOSrjx5kefgA4zdGhg=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:11.690874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-4d79ff89-226b-49b3-98ee-9512c7e3d86a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:44:11.705844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-4d79ff89-226b-49b3-98ee-9512c7e3d86a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:44:11.777659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4d79ff89-226b-49b3-98ee-9512c7e3d86a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135066 Aug 02 09:44:11.778767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2220/3806] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:44:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:12.264645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:12.266468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:12.278476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:12.279665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:12.281404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:12.282151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:12.295954 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:12.297187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:12.314573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:12.315275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:12.316466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:12.317887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:12.548715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:12.563503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:12.566386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:12.568278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33173a0e-11a2-42c9-b356-9ebd6f73bd5f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.277890 Aug 02 09:44:12.587539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2221/3807] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:12 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:44:12.650520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:12.662257 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2ece60f7-61c6-4de2-a6ce-df3b85fad966 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.404919 Aug 02 09:44:12.665752 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1587/3808] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:12 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:12.895800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-2c75d403-5fc6-4a3a-8566-0409753de5dc req-2e58b91c-b12a-43fd-80a2-abe03f803f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "name": "network-vif-plugged", "status": "completed", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:12.905719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-2c75d403-5fc6-4a3a-8566-0409753de5dc req-2e58b91c-b12a-43fd-80a2-abe03f803f66 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:12.906166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-2c75d403-5fc6-4a3a-8566-0409753de5dc req-2e58b91c-b12a-43fd-80a2-abe03f803f66 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:12.920222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-2c75d403-5fc6-4a3a-8566-0409753de5dc req-2e58b91c-b12a-43fd-80a2-abe03f803f66 service nova] Creating event network-vif-plugged:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:44:12.925538 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-2c75d403-5fc6-4a3a-8566-0409753de5dc req-2e58b91c-b12a-43fd-80a2-abe03f803f66 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249086 Aug 02 09:44:12.926397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2222/3809] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:13.592583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:13.593221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:13.595654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:13.601064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:13.601541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:13.602302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:13.602730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:13.692813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:13.698884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:13.699670 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:13.706326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:13.706850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:13.707801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:13.708298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:13.746480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:13.754952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:13.757268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:13.758816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aec339ee-7335-4b05-bc14-b06a2185c218 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.170117 Aug 02 09:44:13.759370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1588/3810] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:13 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:44:13.771031 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1134044097", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "525d665a-147a-4b35-9ac1-0f68a0b121ae"}], "security_groups": [{"name": "tempest-securitygroup--2142622211"}], "key_name": "tempest-keypair-349233501", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:13.841941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:13.850061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b43ed564-3fc3-40ec-96f8-601dee73805a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.159489 Aug 02 09:44:13.850669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2223/3811] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:13 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:13.866747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] validate_networks() for [('525d665a-147a-4b35-9ac1-0f68a0b121ae', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:44:14.338685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:44:14.339109 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:44:14.339605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:44:14.340014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:44:14.340424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:44:14.349889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:14.350339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:14.351135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:14.351578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:14.368744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:44:14.372656 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:44:14.383909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:44:14.386176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:44:14.433351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-62a17470-e530-4406-a8ed-5f344f05acdc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.672907 Aug 02 09:44:14.434006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1589/3812] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:44:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:44:14.445284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-60a545ac-7c80-4f0a-b46d-427c7842f623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:14.445937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-60a545ac-7c80-4f0a-b46d-427c7842f623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:14.503010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-60a545ac-7c80-4f0a-b46d-427c7842f623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:14.510084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-60a545ac-7c80-4f0a-b46d-427c7842f623 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1245 microversion: 2.1 time: 0.069052 Aug 02 09:44:14.510660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2224/3813] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:14 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:14.783089 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:14.783839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:14.791742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:14.792417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:14.793614 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:14.794020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:14.873360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:14.874155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:14.882878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:14.883334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:14.884270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:14.884566 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:14.889596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:14.953915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:14.962816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:14.964546 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:14.965662 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7fcf8874-0774-4fe7-a8fe-168a49fdb107 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1412 microversion: 2.20 time: 0.187404 Aug 02 09:44:14.966185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1590/3814] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:14 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:44:15.022418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:15.030387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b70c3db-1f46-412e-a01c-7abb65e4535c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.162540 Aug 02 09:44:15.030965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2225/3815] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:14 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:44:15.531688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:15.533352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:15.540470 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:15.540928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:15.541741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:15.542381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:15.616695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:15.624359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-93b619d5-4f04-4998-9d88-1bd379db516f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1315 microversion: 2.1 time: 0.096576 Aug 02 09:44:15.624949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1591/3816] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:15 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:15.988016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:15.989224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:15.997267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:15.997524 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:15.998352 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:15.998975 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.052995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:16.053679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:16.060144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:16.060603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.061408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:16.061850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.197225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:16.201474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:16.205825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-32ad25b6-2bb8-45ba-bf5d-f7655e11ea4c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157321 Aug 02 09:44:16.206421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1592/3817] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:16 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:16.212685 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:16.214241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:16.215406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-359ea7da-5606-4e0b-bdd4-b46e06fb0868 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1604 microversion: 2.20 time: 0.231492 Aug 02 09:44:16.231763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2226/3818] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:44:15 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:44:16.238305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:16.238935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:16.245390 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:16.245847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.246623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:16.247062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.326633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0f803765-dbe7-4be0-82b0-bb03dfd606a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092481 Aug 02 09:44:16.327482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1593/3819] 10.222.0.100 () {60 vars in 1321 bytes} [Tue Aug 2 09:44:16 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:44:16.646208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:16.647005 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:16.653470 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:16.654039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.654933 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:16.655465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:16.887715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:16.898383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6d7ad01a-11c5-442c-bf7a-69df08b1ced7 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.256711 Aug 02 09:44:16.899735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2227/3820] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:16 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:17.216477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-69a91f8c-a4bd-410d-b5f1-a6304f48abd4 req-41a7615d-eef6-457a-b36d-18fc93f69ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68e4ad-23db-4b96-8dac-dbbc3fcbd314", "tag": "f1439f67-b807-4093-807d-42caebef5613"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:17.228795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:17.229434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:17.236513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:17.237247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:17.238343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:17.239447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:17.243250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-69a91f8c-a4bd-410d-b5f1-a6304f48abd4 req-41a7615d-eef6-457a-b36d-18fc93f69ae9 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:17.243840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-69a91f8c-a4bd-410d-b5f1-a6304f48abd4 req-41a7615d-eef6-457a-b36d-18fc93f69ae9 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:17.259602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-69a91f8c-a4bd-410d-b5f1-a6304f48abd4 req-41a7615d-eef6-457a-b36d-18fc93f69ae9 service nova] Creating event network-changed:f1439f67-b807-4093-807d-42caebef5613 for instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 on hv-cinder-80382 Aug 02 09:44:17.284519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-69a91f8c-a4bd-410d-b5f1-a6304f48abd4 req-41a7615d-eef6-457a-b36d-18fc93f69ae9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071521 Aug 02 09:44:17.285336 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1594/3821] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:17.487507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:17.497479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b2567946-9407-4670-92e6-6fad061c0793 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.272453 Aug 02 09:44:17.511472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2228/3822] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:17 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:44:17.630779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-473c70cb-fb82-4ca4-9909-84ec26ea2665 req-9e24a9da-1bef-4651-b0f6-3ff919038b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:17.641168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-473c70cb-fb82-4ca4-9909-84ec26ea2665 req-9e24a9da-1bef-4651-b0f6-3ff919038b66 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:17.641885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-473c70cb-fb82-4ca4-9909-84ec26ea2665 req-9e24a9da-1bef-4651-b0f6-3ff919038b66 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:17.653827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-473c70cb-fb82-4ca4-9909-84ec26ea2665 req-9e24a9da-1bef-4651-b0f6-3ff919038b66 service nova] Creating event network-changed:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:44:17.658937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-473c70cb-fb82-4ca4-9909-84ec26ea2665 req-9e24a9da-1bef-4651-b0f6-3ff919038b66 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 Aug 02 09:44:17.660261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1595/3823] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:17.920143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:17.920901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:17.927152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:17.927600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:17.928370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:17.928807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:18.061844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:18.070624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b67cb884-226a-4f8d-80cd-65bd1080528f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.154764 Aug 02 09:44:18.071431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2229/3824] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:17 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:18.519719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:18.520480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:18.527237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:18.527685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:18.528446 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:18.528881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:18.662360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:18.670447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c2eb2500-055b-4bb3-a4f5-f5c645d097a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155178 Aug 02 09:44:18.671044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1596/3825] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:18 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:19.091256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:19.092056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:19.099216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:19.099658 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:19.100443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:19.100890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:19.264638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:19.276434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d95f2e80-b2be-4d5c-a5de-e1cd9ce34c69 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.189147 Aug 02 09:44:19.277018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2230/3826] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:19 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:19.692654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:19.693302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:19.699824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:19.700278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:19.701044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:19.701512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:19.835706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:19.844007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f1f0b4d9-e251-4365-ae49-425ae14d0cc0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155968 Aug 02 09:44:19.844584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1597/3827] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:19 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:20.297423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:20.298043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:20.304598 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:20.305047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:20.305865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:20.306302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:20.439282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:20.446803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a4fda61-5b44-41e5-9966-d0e63cec4c02 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.153310 Aug 02 09:44:20.447392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2231/3828] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:20 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:20.865493 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:20.866112 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:20.869672 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:20.874049 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:20.874502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:20.875281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:20.875722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:21.008936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:21.016883 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-90e15a5c-0b14-4ef0-bbde-767e84153fe0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155391 Aug 02 09:44:21.017484 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1598/3829] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:20 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:21.468547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:21.469170 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:21.476474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:21.476918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:21.477699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:21.478132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:21.608021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:21.616030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3248ae5c-5cb7-45ef-99ce-9b8fb971707f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.151405 Aug 02 09:44:21.616603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2232/3830] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:21 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:22.038868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:22.039491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:22.046027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:22.046485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:22.047251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:22.047695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:22.178364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:22.186207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cd9592a5-8695-455a-b9d0-c5875f5742c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152049 Aug 02 09:44:22.186768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1599/3831] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:22 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:22.428687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-b201672d-c283-44a0-99cb-10e6e1414145 req-21a2dd10-bcdb-4121-b549-7a00059c19d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c68e4ad-23db-4b96-8dac-dbbc3fcbd314", "name": "network-vif-plugged", "status": "completed", "tag": "f1439f67-b807-4093-807d-42caebef5613"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:22.440316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b201672d-c283-44a0-99cb-10e6e1414145 req-21a2dd10-bcdb-4121-b549-7a00059c19d6 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:22.440764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-b201672d-c283-44a0-99cb-10e6e1414145 req-21a2dd10-bcdb-4121-b549-7a00059c19d6 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:22.452605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-b201672d-c283-44a0-99cb-10e6e1414145 req-21a2dd10-bcdb-4121-b549-7a00059c19d6 service nova] Creating event network-vif-plugged:f1439f67-b807-4093-807d-42caebef5613 for instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 on hv-cinder-80382 Aug 02 09:44:22.459265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-b201672d-c283-44a0-99cb-10e6e1414145 req-21a2dd10-bcdb-4121-b549-7a00059c19d6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Aug 02 09:44:22.460572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2233/3832] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:22.637352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:22.637975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:22.644172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:22.645386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:22.646178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:22.646619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:22.778774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:22.786127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3b9ce793-eb48-48df-9361-ef2d62a567fd tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.152588 Aug 02 09:44:22.786692 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1600/3833] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:22 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:23.210167 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:23.210863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:23.217017 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:23.217490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:23.218245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:23.218676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:23.348902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:23.357230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8b7a3681-762d-4d47-bd18-2a66558e4b7d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152262 Aug 02 09:44:23.357610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2234/3834] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:23 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:23.807477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:23.808093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:23.814817 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:23.815267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:23.816046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:23.817133 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:23.945955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:23.953309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-efe43ead-47af-4724-a447-91f07bb21f57 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1371 microversion: 2.1 time: 0.149730 Aug 02 09:44:23.953874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1601/3835] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:23 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:24.380457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:24.381067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:24.388618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:24.389063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:24.389866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:24.390299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:24.508320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=16 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:24.522423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:24.530178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a6d5e18-ad71-4dba-a886-e6637a1f6aee tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154690 Aug 02 09:44:24.530761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2235/3836] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:24 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:24.974994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:24.975612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:24.977479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:24.978237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:24.984791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:24.985280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:24.986054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:24.986495 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:25.121927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:25.129898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-39b2667c-8f09-4d85-b946-afb7b2a164d1 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1561 microversion: 2.1 time: 0.159443 Aug 02 09:44:25.130463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1602/3837] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:24 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:25.150720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:25.151221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:25.157367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:25.157825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:25.158589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:25.159029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:25.233974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cd4860d8-6606-4e78-a1be-08a0d4ab9378 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087187 Aug 02 09:44:25.234575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2236/3838] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:44:25 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:25.552370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:25.552976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:25.559000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:25.559452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:25.560208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:25.560642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:25.690306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:25.699080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5a7ccf95-01a9-4ab4-aff0-922026439b00 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151144 Aug 02 09:44:25.699669 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1603/3839] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:25 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:26.278858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-dcb54191-5683-47b6-9ecc-ae40490ad70f req-553ec151-b4fb-4b1d-8433-c874334ca7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68e4ad-23db-4b96-8dac-dbbc3fcbd314", "tag": "f1439f67-b807-4093-807d-42caebef5613"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:44:26.289897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-dcb54191-5683-47b6-9ecc-ae40490ad70f req-553ec151-b4fb-4b1d-8433-c874334ca7f8 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:26.290463 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-dcb54191-5683-47b6-9ecc-ae40490ad70f req-553ec151-b4fb-4b1d-8433-c874334ca7f8 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:26.302767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-dcb54191-5683-47b6-9ecc-ae40490ad70f req-553ec151-b4fb-4b1d-8433-c874334ca7f8 service nova] Creating event network-changed:f1439f67-b807-4093-807d-42caebef5613 for instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 on hv-cinder-80382 Aug 02 09:44:26.307911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-dcb54191-5683-47b6-9ecc-ae40490ad70f req-553ec151-b4fb-4b1d-8433-c874334ca7f8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Aug 02 09:44:26.308609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2237/3840] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:44:26.727999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:26.730620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:26.743310 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:26.744155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:26.745181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:26.745862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:26.777509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:26.977290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:26.986784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4a142431-3408-46f7-b7c7-f88087690f88 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.269813 Aug 02 09:44:26.987376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1604/3841] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:26 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:28.009451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:28.010185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:28.016319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:28.016772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:28.017554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:28.017994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:28.153592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:28.162343 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33f56829-d2af-4870-a56e-2460fbab832e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.158212 Aug 02 09:44:28.162968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2238/3842] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:28 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:29.183925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:29.184555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:29.191561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:29.192028 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:29.192795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:29.193273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:29.322119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:29.331165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9d92f738-28b8-4d2e-9123-63aa49977a4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151162 Aug 02 09:44:29.332888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1605/3843] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:29 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:30.353627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:30.354326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:30.360797 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:30.361291 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:30.362061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:30.362498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:30.491981 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:30.499925 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d3be8772-8c73-4a02-8282-2bc67f01699d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150396 Aug 02 09:44:30.500480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2239/3844] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:30 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:31.523263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:31.523892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:31.530328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:31.530803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:31.531604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:31.532043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:31.665530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:31.673499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1892dcac-67a3-4208-8a70-749df3f7c789 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154643 Aug 02 09:44:31.674066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1606/3845] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:31 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:32.694518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:32.695074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:32.701554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:32.702008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:32.702775 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:32.703214 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:32.834512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:32.842445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1e150bf9-21bc-4017-b1ff-e3f45c9beaef tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152119 Aug 02 09:44:32.843016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2240/3846] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:32 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:33.864212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:33.864834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:33.871444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:33.871961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:33.872764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:33.873231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:34.005918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:34.014122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-258d2bad-df53-48f6-adcc-cbe91b98f6ca tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154189 Aug 02 09:44:34.014693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1607/3847] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:33 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:35.036109 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:35.036714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:35.039415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:35.045479 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:35.045935 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:35.046735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:35.047172 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:35.178101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:35.186043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8628e8f7-741d-422d-8e87-81ce12b0a54e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154582 Aug 02 09:44:35.186611 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2241/3848] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:35 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:36.207207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:36.208104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:36.215009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:36.215458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:36.216240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:36.216680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:36.354830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:36.363463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b5d7f03d-70eb-4498-9ec7-35d3bdc759f6 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160831 Aug 02 09:44:36.364035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1608/3849] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:36 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:37.387236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:37.387850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:37.395519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:37.395973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:37.396748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:37.397217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:37.524763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:37.539529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9d7f5fcd-26a5-4bc0-89e4-062b896268b4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156178 Aug 02 09:44:37.540119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2242/3850] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:37 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:38.562203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:38.562814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:38.570743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:38.571438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:38.572215 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:38.572659 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:38.711093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:38.719602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-09a37406-94a0-4288-9bf0-ce60afad4fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.162040 Aug 02 09:44:38.720180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1609/3851] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:38 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:39.744550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:39.745175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:39.751834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:39.752282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:39.753213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:39.753650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:39.772357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=100 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:39.902402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:39.911341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3a436340-6f37-4212-b346-bbbca43fae19 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.170703 Aug 02 09:44:39.911927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2243/3852] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:39 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:40.932951 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:40.933674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:40.940189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:40.941413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:40.942267 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:40.942700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:41.073146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:41.081751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e841cbeb-7cf0-445d-9e70-6e2df88804a5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152050 Aug 02 09:44:41.082426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1610/3853] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:40 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:42.104060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:42.104710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:42.111606 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:42.112057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:42.113164 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:42.113659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:42.242324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:42.250278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b265ef40-4b61-4dbf-8492-45861cf4733b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150290 Aug 02 09:44:42.250851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2244/3854] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:42 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:43.271835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:43.272455 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:43.279048 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:43.279500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:43.280297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:43.280743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:43.410312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:43.418237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-01343bde-6eea-460a-8c55-7233e986327e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150354 Aug 02 09:44:43.418826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1611/3855] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:44.439853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:44.441105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:44.447565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:44.448007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:44.448760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:44.449222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:44.581831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:44.589664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-66e79821-4bec-4ba3-9253-64fa843add78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153683 Aug 02 09:44:44.590232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2245/3856] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:44 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:45.610625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:45.611247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:45.617832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:45.618291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:45.619057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:45.619499 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:45.760544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:45.768728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-16478382-7397-40a1-b65c-405cd29a6547 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161967 Aug 02 09:44:45.769325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1612/3857] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:46.790727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:46.791331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:46.798079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:46.798518 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:46.799267 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:46.799699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:46.929393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:46.937255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5f9e61bc-191f-4e77-9343-16a1bb5940dd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150383 Aug 02 09:44:46.937825 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2246/3858] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:46 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:44:47.958825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:47.959439 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:47.966121 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:47.966573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:47.967334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:47.967773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:48.098931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:48.106927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e6743d01-3b62-4971-949d-f50140e97312 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151951 Aug 02 09:44:48.107509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1613/3859] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:47 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:49.129175 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:49.129715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:49.136404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:49.136855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:49.137637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:49.138073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:49.270972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:49.279020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dc455926-7e7a-41df-8e5c-6640539cebf0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154727 Aug 02 09:44:49.279793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2247/3860] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:49 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:50.301399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:50.302014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:50.308480 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:50.308934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:50.309747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:50.310188 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:50.441707 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:50.449703 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c64ef836-816a-4296-a89f-6993e89e37f7 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152755 Aug 02 09:44:50.450214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1614/3861] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:51.470754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:51.471498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:51.478199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:51.478649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:51.479412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:51.479857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:51.606616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:51.614887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f4dbc1aa-f08f-4986-8bb3-39c61039b379 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.148081 Aug 02 09:44:51.615460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2248/3862] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:52.636964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:52.637619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:52.639898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=33 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:52.645671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:52.646129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:52.646964 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:52.647403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:52.777272 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:52.785624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-28e2197b-97f0-4583-b8e1-f5bba78ecd53 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152141 Aug 02 09:44:52.786197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1615/3863] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:52 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:53.460625 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:53.461226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:53.467631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:53.468084 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:53.468844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:53.469316 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:53.492430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f2fb6971-06ff-4acf-95d5-2c78abc5c499 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/ips" status: 200 len: 152 microversion: 2.20 time: 0.036332 Aug 02 09:44:53.493002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2249/3864] 10.222.0.100 () {60 vars in 1294 bytes} [Tue Aug 2 09:44:53 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:44:53.806599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:53.807212 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:53.813746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:53.814198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:53.814965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:53.815405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:53.949668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:53.958456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8b9e2436-babd-442b-a4ad-f0f6ea301988 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155699 Aug 02 09:44:53.959063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1616/3865] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:53 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:54.979691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:54.980311 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:54.987173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:54.987627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:54.988495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:54.988938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:55.118963 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:55.126941 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8fea7c2b-657e-41c0-b2a9-50db4fe03984 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151229 Aug 02 09:44:55.127523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2250/3866] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:56.148980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:56.149625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:56.156093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:56.156543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:56.157345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:56.157789 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:56.287016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:56.295639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-94da6753-1226-4260-8852-ab782eea0ecb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150580 Aug 02 09:44:56.296207 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1617/3867] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:56 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:57.317261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:57.317892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:57.324199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:57.324652 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:57.325452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:57.325894 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:57.456184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:57.464779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa949b26-c1a4-44da-a5ed-136764eee95c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152076 Aug 02 09:44:57.465414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2251/3868] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:57 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:58.486840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:58.487460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:58.494727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:58.495189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:58.495956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:58.496398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:58.498959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=81 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:44:58.626741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:58.635397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-822c8255-a498-4a4e-8401-3b47f51fd652 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.152588 Aug 02 09:44:58.635966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1618/3869] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:58 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:44:59.656162 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:44:59.656783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:44:59.664104 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:59.664565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:59.665366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:44:59.665962 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:44:59.800298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:44:59.808410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a9f5c9fd-87b4-470c-b94f-7333e430af68 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156381 Aug 02 09:44:59.808999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2252/3870] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:44:59 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:00.832688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:00.833332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:00.839375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:00.839827 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:00.840590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:00.841026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:00.977260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:00.985213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e0dcc982-1c3b-4460-91f5-8b32809a68df tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157598 Aug 02 09:45:00.985784 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1619/3871] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:00 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:02.007605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:02.008244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:02.014857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:02.015304 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:02.016073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:02.016513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:02.150932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:02.158997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-998a09b2-d9cf-45d3-84bf-e89a770a4128 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156110 Aug 02 09:45:02.159851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2253/3872] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:02 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:02.241077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:02.241739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:02.248083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:02.248531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:02.249325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:02.249780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:02.273858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-79d847d7-c205-4df8-b1b0-f1fdc5eeebc5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/ips" status: 200 len: 149 microversion: 2.1 time: 0.037177 Aug 02 09:45:02.274429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1620/3873] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:45:02 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:45:03.180793 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:03.181393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:03.188226 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:03.188698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:03.190530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:03.190530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:03.333197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:03.341256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2886633c-f928-4c8f-9d26-902df792f162 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.164502 Aug 02 09:45:03.341851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2254/3874] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:03 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:04.364224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:04.364826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:04.371335 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:04.371968 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:04.372743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:04.373224 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:04.502608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:04.511260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-df117379-4f88-4d4d-aca2-57c0a07ca5ed tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151704 Aug 02 09:45:04.511835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1621/3875] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:04 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:05.532875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:05.533605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:05.536331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=28 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:05.541851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:05.542308 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:05.543081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:05.543520 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:05.683021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:05.691432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4378e784-33c6-4e9b-a73a-352f429aa078 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.162261 Aug 02 09:45:05.692012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2255/3876] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:05 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:45:06.713408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:06.714044 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:06.720819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:06.721288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:06.722421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:06.722891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:06.867447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:06.875738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c240998a-6272-4447-b4ec-c0c909c6b37f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.166264 Aug 02 09:45:06.876313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1622/3877] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:06 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:07.897253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:07.897879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:07.904992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:07.905579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:07.906367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:07.906807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:08.045898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:08.054855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-533c6132-1719-47c9-8744-097da28cca4e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161554 Aug 02 09:45:08.055439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2256/3878] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:07 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:09.075941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:09.076530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:09.083262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:09.083653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:09.084407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:09.084836 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:09.211925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:09.219959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dd6ca9df-1ec5-4078-a0a2-97907abda679 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.147823 Aug 02 09:45:09.220531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1623/3879] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:09 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:10.241833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:10.242394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:10.248849 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:10.249331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:10.250099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:10.250534 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:10.255519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=79 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:10.386386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:10.395428 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9de813f6-6c2a-412a-a73f-951ea2be3ce1 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.157698 Aug 02 09:45:10.396012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2257/3880] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:10 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:11.416556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:11.417181 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:11.423936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:11.424385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:11.425189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:11.425733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:11.573328 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:11.582178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-640610dd-7130-4357-8c40-286eba0ca147 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.169345 Aug 02 09:45:11.582756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1624/3881] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:11 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:12.604031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:12.604651 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:12.611250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:12.611700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:12.613158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:12.613603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:12.748549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:12.756857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c9465a9e-ec23-495b-8e05-5b57452b1d3e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156855 Aug 02 09:45:12.757728 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2258/3882] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:12 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:13.779401 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:13.780018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:13.786831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:13.787286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:13.788059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:13.788500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:13.928482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:13.936362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aca653f0-fc29-4a53-8aaf-2fdf15eac7e5 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160883 Aug 02 09:45:13.936920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1625/3883] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:13 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:14.958891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:14.959542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:14.966137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:14.966589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:14.967361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:14.967802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:15.102773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:15.110769 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a3d23c9b-9481-4ec3-93d6-366e00fa59d9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156701 Aug 02 09:45:15.111342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2259/3884] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:14 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:16.133080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:16.133717 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:16.140137 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:16.140590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:16.141389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:16.141833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:16.270317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:16.278226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ad85ed67-8ad5-4c52-95df-d7ce00b1c1fd tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.149486 Aug 02 09:45:16.278802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1626/3885] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:16 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:17.299440 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:17.300060 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:17.306657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:17.307097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:17.307857 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:17.308287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:17.448877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:17.457569 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6ff7ecb1-aaeb-481d-9497-09d71f6c1ce4 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.162009 Aug 02 09:45:17.458156 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2260/3886] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:17 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:18.480955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:18.481715 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:18.490699 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:18.491153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:18.491938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:18.492378 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:18.634889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:18.644168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a4b782fc-2126-4c09-802d-21982f92dc28 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.167061 Aug 02 09:45:18.644748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1627/3887] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:18 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:19.665776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:19.666420 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:19.673327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:19.673778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:19.675295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:19.675748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:19.806978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:19.815638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4af85343-116e-40bc-b8c9-90b001311c78 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153097 Aug 02 09:45:19.816332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2261/3888] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:19 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:20.838282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:20.838935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:20.845395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:20.845838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:20.846689 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:20.847122 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:20.976526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:20.984429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e32e3f63-0ced-4845-bf20-21da049138af tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.150007 Aug 02 09:45:20.984987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1628/3889] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:20 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:22.008950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:22.010198 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:22.022934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:22.023703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:22.025100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:22.025929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:22.192008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:22.200868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b811fc7e-0f49-4d5a-b517-a4e9af016827 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.198339 Aug 02 09:45:22.201492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2262/3890] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:22 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:45:23.223019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:23.223559 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:23.226694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=28 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:23.232361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:23.232810 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:23.233607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:23.234043 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:23.371725 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:23.379977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98224543-e1ea-4808-831d-0271082d785b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.160895 Aug 02 09:45:23.380561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1629/3891] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:23 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:24.406341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:24.407315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:24.415355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:24.415805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:24.416631 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:24.417070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:24.556484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:24.564944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-08f4b63c-63c8-488c-bcdf-5f0f1b9e0570 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.165028 Aug 02 09:45:24.565616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2263/3892] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:24 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:25.586889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:25.587489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:25.593897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:25.594340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:25.595096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:25.595532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:25.736900 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:25.744930 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f6f0f351-1004-448a-a33b-defe891530e9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161913 Aug 02 09:45:25.745536 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1630/3893] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:25 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:26.766437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:26.767061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:26.774137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:26.774593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:26.775395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:26.775833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:26.907194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:26.915578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b19c50e3-f149-4025-b397-c076c905be38 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153191 Aug 02 09:45:26.916409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2264/3894] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:26 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:27.936630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:27.937277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:27.943942 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:27.944400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:27.945205 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:27.945648 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:28.083178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:28.091163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e61d024d-fef1-4582-ac7c-612339e7ff3a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.158461 Aug 02 09:45:28.091741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1631/3895] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:27 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:29.113831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:29.114387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:29.120780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:29.121253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:29.122007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:29.122439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:29.254959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:29.263443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-060712ff-78f6-4e13-a0a7-f6acaabe6639 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154184 Aug 02 09:45:29.264039 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2265/3896] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:29 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:30.285808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:30.286403 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:30.292821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:30.293305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:30.294066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:30.294500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:30.297010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=82 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:30.429436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:30.437333 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bf405cd9-4f5f-4db6-8b13-095186a3c87e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155913 Aug 02 09:45:30.437905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1632/3897] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:30 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:31.459238 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:31.459902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:31.466937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:31.467393 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:31.468257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:31.468810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:31.603212 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:31.612019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2a20102f-00a7-4174-9086-f0bb1a0f2ece tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.156798 Aug 02 09:45:31.612609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2266/3898] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:31 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:32.633500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:32.634104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:32.640452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:32.640905 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:32.641709 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:32.642153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:32.774800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:32.782741 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2c1af721-b76c-44ac-9d3b-034f17d02fbe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153462 Aug 02 09:45:32.783975 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1633/3899] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:32 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:33.806273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:33.806877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:33.813539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:33.813993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:33.815803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:33.816245 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:33.961157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:33.969920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-15111067-fa17-4f16-b602-ce209fdb8b3f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.168281 Aug 02 09:45:33.970575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2267/3900] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:33 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:34.992268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:34.992886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:34.999386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:34.999844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:35.000609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:35.001053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:35.133679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:35.141533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-87905595-a735-468c-b9b0-6c732754a691 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153248 Aug 02 09:45:35.142106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1634/3901] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:34 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:36.163798 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:36.164368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:36.166660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=26 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:36.172045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:36.172486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:36.173275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:36.173917 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:36.318390 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:36.327299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7ca0c0b3-9087-452e-878e-6dad9f5e8d76 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.167464 Aug 02 09:45:36.327898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2268/3902] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:36 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:45:37.349485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:37.350171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:37.357000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:37.357478 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:37.358254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:37.358690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:37.490974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:37.499006 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c323e0ab-5547-4d02-8efc-80c672429eaa tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.154054 Aug 02 09:45:37.499575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1635/3903] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:37 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:38.521718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:38.522324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:38.529325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:38.529779 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:38.530557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:38.530995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:38.663544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:38.671443 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-47d1829a-8e72-4ab8-8da3-32c7c8d06e26 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153656 Aug 02 09:45:38.672024 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2269/3904] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:38 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:39.693929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:39.694544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:39.701201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:39.701663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:39.702435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:39.702879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:39.852615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:39.862345 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-309a3a02-9384-423f-a855-76a11455cfe2 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.172185 Aug 02 09:45:39.863037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1636/3905] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:39 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:40.896942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:40.897562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:40.904207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:40.905340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:40.906137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:40.906596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:40.910031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=78 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:41.068265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:41.081650 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f443182a-3767-4d69-beda-e200185c29c8 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.189415 Aug 02 09:45:41.082292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2270/3906] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:40 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:42.106268 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:42.107466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:42.119612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:42.120274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:42.121466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:42.122196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:42.302638 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:42.315873 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-29436e04-5684-42e0-a692-f078dc98e97c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.215951 Aug 02 09:45:42.316591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1637/3907] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:42 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:43.338721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:43.339576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:43.347439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:43.347862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:43.348706 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:43.349168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:43.482190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:43.490559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87d77244-eefd-4089-b9d5-1df3bf04d57a tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.155942 Aug 02 09:45:43.491138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2271/3908] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:43 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:44.512800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:44.513712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:44.521104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:44.521803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:44.522588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:44.523027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:44.963749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:44.974382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-721da211-81af-4d5a-9283-3eff399b4311 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.465573 Aug 02 09:45:44.974992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1638/3909] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:44 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:45.998362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:45.999149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:46.006403 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:46.007112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:46.007891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:46.008328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:46.163850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:46.175603 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5415d7f7-1af3-46ae-8443-af426f70182c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.180962 Aug 02 09:45:46.176601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2272/3910] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:45 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:47.198459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:47.199077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:47.206307 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:47.206750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:47.207512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:47.207946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:47.338306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:47.347425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d67d3591-c263-40d4-b6f1-0c014cd0495b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.153007 Aug 02 09:45:47.348008 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1639/3911] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:47 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:48.368903 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:48.369655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:48.376401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:48.376904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:48.377684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:48.378105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:48.508571 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:48.516709 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-474e3de5-3945-41dc-a842-852f904d2f1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.151695 Aug 02 09:45:48.517662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2273/3912] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:48 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:49.539071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:49.539674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:49.546623 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:49.547166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:49.548131 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:49.548617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:49.688233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:49.696902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3e3789f6-7047-4a5c-be9f-4f84f1639b15 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.161679 Aug 02 09:45:49.697505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1640/3913] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:49 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:50.718010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:50.718673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:50.725203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:50.725647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:50.726404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:50.726830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:50.885938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:50.894264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f21fded3-9846-4433-bfe3-31649d3f1c47 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.180025 Aug 02 09:45:50.894852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2274/3914] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:50 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:51.921654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:51.923393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:51.933134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:51.934667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:51.936464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:51.937590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:52.170339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:52.184855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88bcd3fe-aedc-4dde-a782-b33e981c4beb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.271066 Aug 02 09:45:52.187210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1641/3915] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:51 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:52.209691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5a6a3f19-e115-4af4-bff0-7c5e32d8a379 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] Calling method '.version_select at 0x7f8c180898b0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:52.239126 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5a6a3f19-e115-4af4-bff0-7c5e32d8a379 tempest-TestVolumeBootPattern-1478851430 tempest-TestVolumeBootPattern-1478851430-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1891613438" status: 202 len: 0 microversion: 2.1 time: 0.033155 Aug 02 09:45:52.239961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2275/3916] 10.222.0.100 () {58 vars in 1268 bytes} [Tue Aug 2 09:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1891613438 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:45:53.120804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fab11bf3-20ba-418c-b540-f4e6c14ddaf9"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:45:53.124405 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:53.134847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:53.135300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:53.136206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:53.137023 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:53.214845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:53.215578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:53.228906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:53.229483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:53.230368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:53.232971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:53.379979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:53.396904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-12a76e44-a34b-42ad-bd68-c5f0d14e9310 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1563 microversion: 2.1 time: 0.186203 Aug 02 09:45:53.398731 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2276/3917] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:53 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:53.728550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:45:53.729845 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:53.740610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:53.742036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:53.743487 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:53.744464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:53.774327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-88a57c00-7dd9-4056-8f22-f10693eca86f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657220 Aug 02 09:45:53.775060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1642/3918] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:45:53 2022] POST /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:45:53.786553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lazy-loading 'flavor' on Instance uuid d6c0537f-91ad-4f13-ad40-d178194a1d43 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:45:54.045852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cc6a3e0f-3e02-429b-9221-22c01767b286 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/action" status: 202 len: 0 microversion: 2.20 time: 0.324046 Aug 02 09:45:54.046644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2277/3919] 10.222.0.100 () {62 vars in 1324 bytes} [Tue Aug 2 09:45:53 2022] POST /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:45:54.056228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:54.056971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:54.060012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=28 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:54.067299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:54.067842 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:54.068698 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:54.069258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:54.349653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:54.358320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:54.359738 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:54.362066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-522880cc-de21-49c3-a7c9-14506d899d2d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.310464 Aug 02 09:45:54.362608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1643/3920] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:45:54 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:45:54.419497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:54.421085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:54.431667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:54.432117 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:54.433061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:54.433519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:54.659948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-de0a1ede-7f45-4815-9b55-53ac4726b4c5 req-6c27bac5-ddf1-4bd1-bf2a-99e9050d2868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e2d9a6-78b8-4f7a-8216-490f423ba511", "name": "network-vif-deleted", "tag": "817289ba-4f88-470b-aec4-8eae8997d6ce"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:45:54.675494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-de0a1ede-7f45-4815-9b55-53ac4726b4c5 req-6c27bac5-ddf1-4bd1-bf2a-99e9050d2868 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:54.676366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-de0a1ede-7f45-4815-9b55-53ac4726b4c5 req-6c27bac5-ddf1-4bd1-bf2a-99e9050d2868 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:54.692674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-de0a1ede-7f45-4815-9b55-53ac4726b4c5 req-6c27bac5-ddf1-4bd1-bf2a-99e9050d2868 service nova] Creating event network-vif-deleted:817289ba-4f88-470b-aec4-8eae8997d6ce for instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 on hv-cinder-80382 Aug 02 09:45:54.701663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-de0a1ede-7f45-4815-9b55-53ac4726b4c5 req-6c27bac5-ddf1-4bd1-bf2a-99e9050d2868 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046761 Aug 02 09:45:54.702859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1644/3921] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:45:54.874220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:54.882120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a81cc7f9-6bb3-43b7-93c8-1dc967848c74 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1517 microversion: 2.1 time: 0.466919 Aug 02 09:45:54.887507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2278/3922] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:54 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:55.400219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:55.401060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:55.409841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:55.410306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:55.411379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:55.420839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:55.583367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:55.591792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:55.593382 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:55.594663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-20492a8b-b3c9-4441-bc9c-cd7df46744f4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.200723 Aug 02 09:45:55.596029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1645/3923] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:45:55 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:45:55.615978 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-1a250edf-90ae-4a4f-a4c5-d5ba35ddddac req-c0c6ff3c-da7d-489a-8137-187aacd5c875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653f50f6-3df3-4a7a-baef-b1222520a28f", "name": "network-vif-deleted", "tag": "0e3bf58f-f82c-4093-9ec7-de6e0b51441e"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:45:55.628268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-1a250edf-90ae-4a4f-a4c5-d5ba35ddddac req-c0c6ff3c-da7d-489a-8137-187aacd5c875 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:55.629130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-1a250edf-90ae-4a4f-a4c5-d5ba35ddddac req-c0c6ff3c-da7d-489a-8137-187aacd5c875 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:55.641473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-1a250edf-90ae-4a4f-a4c5-d5ba35ddddac req-c0c6ff3c-da7d-489a-8137-187aacd5c875 service nova] Creating event network-vif-deleted:0e3bf58f-f82c-4093-9ec7-de6e0b51441e for instance 653f50f6-3df3-4a7a-baef-b1222520a28f on hv-cinder-80382 Aug 02 09:45:55.646564 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-1a250edf-90ae-4a4f-a4c5-d5ba35ddddac req-c0c6ff3c-da7d-489a-8137-187aacd5c875 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040069 Aug 02 09:45:55.647288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2279/3924] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:45:55.909616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:55.910579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:55.918108 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:55.918564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:55.919385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:55.920613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:56.210591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:56.218503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7351a68a-6ead-410b-83f6-abdab081241b tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1517 microversion: 2.1 time: 0.314098 Aug 02 09:45:56.219061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1646/3925] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:55 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:45:56.622729 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:56.623809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:56.631185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:56.632360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:56.633495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:56.634045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:56.792121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:56.801548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:56.803305 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:56.804627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-61f235d2-2471-44fa-a417-c878d242d3e8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.187582 Aug 02 09:45:56.806886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2280/3926] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:45:56 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:45:57.243397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:57.244425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:57.259448 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:57.260076 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:57.260994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:57.261745 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:57.687418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:57.695759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7029d6a3-9575-468c-a1d8-3c9460d7ad5c tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1517 microversion: 2.1 time: 0.457879 Aug 02 09:45:57.709135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1647/3927] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:57 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:57.829742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:57.830407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:57.836829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:57.837317 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:57.838097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:57.838530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.123389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-484f8262-681e-45e8-ad71-b5d190a4d10e req-e02be336-1506-46e5-af14-d1a760d01e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77bbf4ed-4629-41b6-b0c2-56aed8108028", "name": "network-vif-deleted", "tag": "77abd36f-7703-4513-bced-f8f25bf34dc4"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:45:58.128151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:58.134322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-484f8262-681e-45e8-ad71-b5d190a4d10e req-e02be336-1506-46e5-af14-d1a760d01e6e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.134777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-484f8262-681e-45e8-ad71-b5d190a4d10e req-e02be336-1506-46e5-af14-d1a760d01e6e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.138874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:58.147592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:58.149590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-484f8262-681e-45e8-ad71-b5d190a4d10e req-e02be336-1506-46e5-af14-d1a760d01e6e service nova] Creating event network-vif-deleted:77abd36f-7703-4513-bced-f8f25bf34dc4 for instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 on hv-cinder-80382 Aug 02 09:45:58.155414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-484f8262-681e-45e8-ad71-b5d190a4d10e req-e02be336-1506-46e5-af14-d1a760d01e6e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 Aug 02 09:45:58.156012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1648/3928] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:45:58.163710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:58.164955 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-76787123-4431-4e51-987a-f9a059d88ca7 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.340031 Aug 02 09:45:58.166987 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2281/3929] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:45:57 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:45:58.291558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fab11bf3-20ba-418c-b540-f4e6c14ddaf9"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:45:58.294056 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:58.300891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.301370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.302136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.302572 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.404755 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Invalid volume: volume fab11bf3-20ba-418c-b540-f4e6c14ddaf9 is already attached to instances: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: POST /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments HTTP/1.1 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 74 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:45:58.406806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {"volumeAttachment": {"volumeId": "fab11bf3-20ba-418c-b540-f4e6c14ddaf9"}} Aug 02 09:45:58.408615 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Invalid volume: volume fab11bf3-20ba-418c-b540-f4e6c14ddaf9 is already attached to instances: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '2c68e4ad-23db-4b96-8dac-dbbc3fcbd314', 'body': {'volumeAttachment': {'volumeId': 'fab11bf3-20ba-418c-b540-f4e6c14ddaf9'}}} Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fab11bf3-20ba-418c-b540-f4e6c14ddaf9 is already attached to instances: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:58.413232 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fab11bf3-20ba-418c-b540-f4e6c14ddaf9 is already attached to instances: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:45:58.414693 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fab11bf3-20ba-418c-b540-f4e6c14ddaf9 is already attached to instances: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 400 to user: Invalid volume: volume fab11bf3-20ba-418c-b540-f4e6c14ddaf9 is already attached to instances: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f2c71373-ec53-43c8-86bc-1c5e574c811d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122783 Aug 02 09:45:58.417000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1649/3930] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:45:58 2022] POST /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:45:58.488703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:58.488927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:58.496071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.496071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.496632 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.497071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.593542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lazy-loading 'services' on Instance uuid 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:45:58.694943 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81ede28a-4a79-46e7-85a4-e98d3aee013e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments/fab11bf3-20ba-418c-b540-f4e6c14ddaf9" status: 202 len: 0 microversion: 2.1 time: 0.211105 Aug 02 09:45:58.700366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2282/3931] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:45:58 2022] DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments/fab11bf3-20ba-418c-b540-f4e6c14ddaf9 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:45:58.705309 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:58.707907 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:58.715534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.716129 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.716985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.717700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.745186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:58.746131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:58.753789 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.758043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.758879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.759325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.785101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-917720e9-66c2-4a69-9768-1b215d28632a tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084687 Aug 02 09:45:58.786590 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1650/3932] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:45:58 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:45:58.816540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:58.817192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:58.818035 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'fault' on Instance uuid 77bbf4ed-4629-41b6-b0c2-56aed8108028 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:45:58.897960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:58.910733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-75b49ce3-4617-4170-bf95-c08ad531fff0 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 200 len: 1312 microversion: 2.1 time: 0.185165 Aug 02 09:45:58.911337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2283/3933] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:58 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:45:59.192556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:59.193327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:59.199877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.200329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.201097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.201560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.374070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:59.384279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:59.386643 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:45:59.388093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ad55264-d2d2-4fea-a95d-1cc7a0673de0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.200060 Aug 02 09:45:59.389141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1651/3934] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:45:59 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:45:59.798545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:59.804837 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:59.812174 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.812562 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.813502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.813944 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.844966 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-08c50cea-f369-4604-9f4b-cc2d3a9bac1d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050895 Aug 02 09:45:59.845707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2284/3935] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:45:59 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:45:59.935867 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:59.936543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:45:59.936686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:59.937967 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: 77bbf4ed-4629-41b6-b0c2-56aed8108028] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:45:59.944191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.944638 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.945454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.945609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.945886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.946058 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.946783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:45:59.947283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:45:59.967673 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:45:59.970981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 could not be found. Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 HTTP/1.1 Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:45:59.973582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 could not be found. Aug 02 09:45:59.975251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '77bbf4ed-4629-41b6-b0c2-56aed8108028'} Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 could not be found. Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:45:59.976315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 could not be found. Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 could not be found. Aug 02 09:45:59.977844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:45:59.980661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 404 to user: Instance 77bbf4ed-4629-41b6-b0c2-56aed8108028 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:45:59.981751 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7230a1f2-0f79-49b2-9472-6c773aaed999 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028" status: 404 len: 111 microversion: 2.1 time: 0.050316 Aug 02 09:45:59.982565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1652/3936] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:45:59 2022] GET /compute/v2.1/servers/77bbf4ed-4629-41b6-b0c2-56aed8108028 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:45:59.985461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:46:00.075068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d302e134-7e64-43df-b7ec-e40b3c4cf396 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 204 len: 0 microversion: 2.1 time: 0.142242 Aug 02 09:46:00.078480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2285/3937] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:45:59 2022] DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:46:00.086332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:00.087285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:00.097442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:00.098278 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:00.100241 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:00.101673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:00.311773 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:00.320719 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9542d8d0-0d88-42cf-b0b4-486a504d7bc9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1685 microversion: 2.1 time: 0.237812 Aug 02 09:46:00.322053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1653/3938] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:00 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1685 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:00.421952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:00.427299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:00.436386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:00.436832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:00.437626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:00.438965 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:00.942532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:00.951222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:00.953052 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:00.955034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d9e10dcc-6951-41ca-90fd-cbf436727ab8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.545243 Aug 02 09:46:00.955617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2286/3939] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:00 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:01.343020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:01.343633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:01.350884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:01.351399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:01.352176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:01.352730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:01.501079 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:01.510256 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0d900f67-1086-41fd-b9fb-dea91d1f9d4e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1685 microversion: 2.1 time: 0.170604 Aug 02 09:46:01.510818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1654/3940] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:01 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:01.978490 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:01.979201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:01.986243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:01.986691 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:01.987459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:01.987891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:02.128422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:02.138300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:02.140279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:02.141719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5600ac93-123a-4039-9d82-36dc016da964 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.167151 Aug 02 09:46:02.142655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2287/3941] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:01 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:02.535015 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:02.535971 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:02.545747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:02.546383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:02.547444 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:02.548024 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:02.685198 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:02.693408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-de31c1f2-ad3c-4535-8110-a59f23f818b2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1685 microversion: 2.1 time: 0.163294 Aug 02 09:46:02.693981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1655/3942] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:02 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:03.165711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:03.166333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:03.173819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:03.174218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:03.174993 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:03.175434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:03.310771 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:03.319572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:03.321072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:03.322264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d050b03d-ff72-46d9-bf65-224dcd857aed tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.160537 Aug 02 09:46:03.322865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2288/3943] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:03 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:03.714840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:03.715456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:03.722938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:03.723379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:03.724154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:03.724591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:03.863431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:03.871301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4e8e68df-8578-4f94-9556-5cb8a6dd7299 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1685 microversion: 2.1 time: 0.160391 Aug 02 09:46:03.871896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1656/3944] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:03 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:04.345957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:04.346712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:04.353578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:04.354157 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:04.354818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:04.355261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:04.611318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:04.620395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:04.622155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:04.624898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-76ca47bc-db56-44e3-a3da-8130657a2207 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.282367 Aug 02 09:46:04.647240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2289/3945] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:04 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:04.867819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-eff6d364-eaef-45ca-97be-e841c7294e82 req-62d5ca38-20af-42f2-b886-48ae337b9f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c68e4ad-23db-4b96-8dac-dbbc3fcbd314", "name": "network-vif-deleted", "tag": "f1439f67-b807-4093-807d-42caebef5613"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:04.880429 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-eff6d364-eaef-45ca-97be-e841c7294e82 req-62d5ca38-20af-42f2-b886-48ae337b9f69 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:04.880880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-eff6d364-eaef-45ca-97be-e841c7294e82 req-62d5ca38-20af-42f2-b886-48ae337b9f69 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:04.895303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-eff6d364-eaef-45ca-97be-e841c7294e82 req-62d5ca38-20af-42f2-b886-48ae337b9f69 service nova] Creating event network-vif-deleted:f1439f67-b807-4093-807d-42caebef5613 for instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 on hv-cinder-80382 Aug 02 09:46:04.899036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:04.900353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:04.907110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-eff6d364-eaef-45ca-97be-e841c7294e82 req-62d5ca38-20af-42f2-b886-48ae337b9f69 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039637 Aug 02 09:46:04.908436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1657/3946] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:04.913501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:04.914261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:04.919131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:04.921999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:05.007355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:05.017337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-015212a0-4173-42c2-b05f-42d79b1e6f62 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 200 len: 1330 microversion: 2.1 time: 0.126384 Aug 02 09:46:05.018232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2290/3947] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:04 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:05.650073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:05.650781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:05.657844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:05.658297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:05.659251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:05.659700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:05.820404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:05.829408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:05.830992 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:05.832185 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17fc46f2-8d1c-418d-8a7a-f14913663010 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1750 microversion: 2.20 time: 0.186456 Aug 02 09:46:05.832749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1658/3948] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:05 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:46:06.038296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:06.038997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:06.046742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:06.047756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:06.048809 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:06.049296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:06.064701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 HTTP/1.1 Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:46:06.066254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:46:06.068098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '2c68e4ad-23db-4b96-8dac-dbbc3fcbd314'} Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:46:06.069276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:46:06.071010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:46:06.072497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:46:06.072497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f437ab77-c5d2-4779-9ea5-7c99531f537e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 404 len: 111 microversion: 2.1 time: 0.033530 Aug 02 09:46:06.072497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2291/3949] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:06 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:46:06.076568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9f183c79-efd7-420f-9dcb-f3aad7c0035d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '.version_select at 0x7f8c1838cd30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:06.096285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9f183c79-efd7-420f-9dcb-f3aad7c0035d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349233501" status: 202 len: 0 microversion: 2.1 time: 0.023453 Aug 02 09:46:06.096870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1659/3950] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:46:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349233501 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:46:06.735827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72b62a3e-e9f8-405f-b5de-6ee9046ac861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: .version_select at 0x7f8c137fcf70>, body: {"keypair": {"name": "tempest-keypair-1121580387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw7kOlD4cVCaoNyoj3nCo9veHrhKGhlzMgSbdgEKb2UYmYgElE7x/r1Iymzm8pC6o0RELuKbeW0lXX5l6TB8Y0r7vpnEfwkTDSjPP79WMdx3NB2gBUhJoHZXBgAzamcCA=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:06.741539 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:06.755057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-72b62a3e-e9f8-405f-b5de-6ee9046ac861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:46:06.760143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-72b62a3e-e9f8-405f-b5de-6ee9046ac861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:46:06.785787 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72b62a3e-e9f8-405f-b5de-6ee9046ac861 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057283 Aug 02 09:46:06.788333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2292/3951] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:46:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:06.861871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:06.862503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:06.868866 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:06.869354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:06.870567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:06.871419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:07.049832 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:07.057847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:07.059349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:07.060510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0e00c04d-9887-46e7-bcc0-52fb066702c0 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1750 microversion: 2.20 time: 0.205635 Aug 02 09:46:07.061059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1660/3952] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:06 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:08.085070 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:08.085692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:08.092386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:08.092834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:08.093640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:08.094138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:08.129796 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1446451182", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "525d665a-147a-4b35-9ac1-0f68a0b121ae"}], "security_groups": [{"name": "tempest-securitygroup--101693117"}], "key_name": "tempest-keypair-1121580387", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:08.229042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:08.236425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] validate_networks() for [('525d665a-147a-4b35-9ac1-0f68a0b121ae', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:46:08.237757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:08.239276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:08.240454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ecc1fc31-aa91-48ef-a4d7-db36d4098fcf tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1750 microversion: 2.20 time: 0.159955 Aug 02 09:46:08.241028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2293/3953] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:08 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:08.622046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:46:08.622514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:46:08.622993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:46:08.623402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:46:08.623813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:46:08.633067 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:08.633548 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:08.634346 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:08.634804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:08.651377 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:46:08.655233 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Getting quotas for user c9633b9cbd8a4332a605ca66d73dc5b1 and project 05905727ed6c41a1b6187fec6e61dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:46:08.666595 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:46:08.668828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:46:08.714468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0f71a222-2710-40f0-b6df-902a4253a377 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.589610 Aug 02 09:46:08.715274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1661/3954] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:46:08 2022] POST /compute/v2.1/servers => generated 403 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 09:46:08.726667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-89418fb3-3b55-4021-92c2-cb09611dad0c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:08.727380 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-89418fb3-3b55-4021-92c2-cb09611dad0c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:08.782131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-89418fb3-3b55-4021-92c2-cb09611dad0c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:08.788946 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-89418fb3-3b55-4021-92c2-cb09611dad0c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1246 microversion: 2.1 time: 0.066133 Aug 02 09:46:08.789504 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2294/3955] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:08 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:09.265568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:09.266811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:09.273690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:09.274151 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:09.274922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:09.275393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:09.405062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:09.412821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:09.414452 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:09.415611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1c8fe707-a7f5-48ae-b947-324d61d94b76 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1750 microversion: 2.20 time: 0.154570 Aug 02 09:46:09.416169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1662/3956] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:09 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:09.810604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:09.811220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:09.819542 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:09.820258 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:09.821442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:09.822241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:09.894596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:09.904618 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf6eb1b4-367f-4400-a0ea-16021be143d6 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1242 microversion: 2.1 time: 0.097938 Aug 02 09:46:09.905866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2295/3957] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:09 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:10.438593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:10.439299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:10.446555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:10.447279 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:10.448513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:10.449226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:10.596486 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:10.605647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:10.607166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:10.608344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b39a57e9-66de-4b74-aa3d-63925b2d4f5b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.174384 Aug 02 09:46:10.613172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1663/3958] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:10 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:10.928785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:10.929441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:10.955120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:10.955120 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:10.963203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:10.963765 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:10.987477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-eaafa7d0-ff7c-4b20-8a1a-cebb31d738dc req-e83b1f56-b8c4-4c8b-91f9-cb834f9aead5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "name": "network-vif-plugged", "status": "completed", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:11.005781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-eaafa7d0-ff7c-4b20-8a1a-cebb31d738dc req-e83b1f56-b8c4-4c8b-91f9-cb834f9aead5 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:11.007617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-eaafa7d0-ff7c-4b20-8a1a-cebb31d738dc req-e83b1f56-b8c4-4c8b-91f9-cb834f9aead5 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:11.048863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-eaafa7d0-ff7c-4b20-8a1a-cebb31d738dc req-e83b1f56-b8c4-4c8b-91f9-cb834f9aead5 service nova] Creating event network-vif-plugged:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:46:11.071045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-eaafa7d0-ff7c-4b20-8a1a-cebb31d738dc req-e83b1f56-b8c4-4c8b-91f9-cb834f9aead5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087549 Aug 02 09:46:11.071720 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1664/3959] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:46:11.100412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:11.114119 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cf84615e-a113-4e8a-ba21-bf7f7af3d5ec tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1304 microversion: 2.1 time: 0.188993 Aug 02 09:46:11.125665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2296/3960] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:10 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:11.345932 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1214846789", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "networks": [{"uuid": "1130a76e-7b0e-4fad-aa2d-3296fa2a5662"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:11.417379 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] validate_networks() for [('1130a76e-7b0e-4fad-aa2d-3296fa2a5662', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:46:11.638090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:11.642359 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:11.670116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:11.671734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:11.674211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:11.675344 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:11.962501 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:11.974279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:11.975522 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:46:11.976727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:46:11.977724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:46:11.978221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:46:11.978706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:46:11.982384 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:11.983692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b84657a6-22ef-41e1-b241-6519213b7508 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.354929 Aug 02 09:46:11.984939 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2297/3961] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:11 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:12.004490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:12.005363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:12.006440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:12.007520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:12.030704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Getting quotas for project 0d0ba64c011a419b9cc8f5501a8606ac. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:46:12.036867 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Getting quotas for user b074a126a458485e882a9e9eea178dca and project 0d0ba64c011a419b9cc8f5501a8606ac. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:46:12.053737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:46:12.056414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:46:12.129700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3d55b91b-12c1-4e12-a782-284fb0d39dff tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.788334 Aug 02 09:46:12.131245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1665/3962] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:46:11 2022] POST /compute/v2.1/servers => generated 382 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:46:12.142279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:12.143053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:12.154066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:12.158924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:12.159931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7559fa61-bd4b-41ac-a02b-23f3e7487ebb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:12.160770 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7559fa61-bd4b-41ac-a02b-23f3e7487ebb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:12.160924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:12.166795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:12.245573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7559fa61-bd4b-41ac-a02b-23f3e7487ebb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:12.254481 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7559fa61-bd4b-41ac-a02b-23f3e7487ebb tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1223 microversion: 2.1 time: 0.107289 Aug 02 09:46:12.272639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1666/3963] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:12 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:12.488548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:12.497216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-904cdcd5-36d3-418e-91d1-0318d9dc3ed9 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1371 microversion: 2.1 time: 0.359423 Aug 02 09:46:12.514086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2298/3964] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:12 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:12.864774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-8bd1bcad-01b5-4703-a260-32b73dd1ef4e req-315b7e6a-d6bc-417c-8929-7614fb6f5944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f0cb26-a5fc-4f18-9837-0c3537cfd024", "tag": "5bc5c237-d37f-4c27-88be-2cd5c6145db7"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:12.886397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-8bd1bcad-01b5-4703-a260-32b73dd1ef4e req-315b7e6a-d6bc-417c-8929-7614fb6f5944 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:12.889464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-8bd1bcad-01b5-4703-a260-32b73dd1ef4e req-315b7e6a-d6bc-417c-8929-7614fb6f5944 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:12.914245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-8bd1bcad-01b5-4703-a260-32b73dd1ef4e req-315b7e6a-d6bc-417c-8929-7614fb6f5944 service nova] Creating event network-changed:5bc5c237-d37f-4c27-88be-2cd5c6145db7 for instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 on hv-cinder-80382 Aug 02 09:46:12.924246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-8bd1bcad-01b5-4703-a260-32b73dd1ef4e req-315b7e6a-d6bc-417c-8929-7614fb6f5944 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063242 Aug 02 09:46:12.925295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1667/3965] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:13.008891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:13.010210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:13.037400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:13.038177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:13.039465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:13.040079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:13.241932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:13.263675 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:13.274031 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:13.279956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:13.280661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:13.285282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4ac436c9-1826-4e7e-b018-8f32a7f98606 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.281524 Aug 02 09:46:13.294805 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:13.295690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:13.301223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2299/3966] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:13 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:13.308037 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:13.308624 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:13.401398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:13.418315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-92661b28-9c36-40d0-a2a5-d02823d12324 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1275 microversion: 2.1 time: 0.142356 Aug 02 09:46:13.429150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1668/3967] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:13 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:13.522988 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:13.524366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:13.533812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:13.534835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:13.535662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:13.536110 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:13.821737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:13.839610 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e1f76ea9-e528-4df6-b851-03882ea56dd5 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1371 microversion: 2.1 time: 0.320367 Aug 02 09:46:13.843340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2300/3968] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:13 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:14.311860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:14.311860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:14.326833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:14.326833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:14.326833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:14.326833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:14.472553 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:14.486528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:14.494438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:14.495155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:14.496255 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:14.496865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:14.642568 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:14.651812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:14.656022 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:14.658922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-020f3538-da18-4428-9a12-3396130982a5 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.354119 Aug 02 09:46:14.669901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1669/3969] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:14 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:14.688016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:14.696453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eacb3439-cc31-4698-a14c-acff6e540f2e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.245204 Aug 02 09:46:14.697665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2301/3970] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:14 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:14.866537 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:14.867219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:14.874087 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:14.874756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:14.875870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:14.876487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:15.179510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:15.191220 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-15720862-a98e-4fb7-ade1-c572bc0c7c9c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1371 microversion: 2.1 time: 0.331905 Aug 02 09:46:15.193898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1670/3971] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:14 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:15.695480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:15.696754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:15.706900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:15.708932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:15.710069 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:15.710713 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:15.719904 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:15.720507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:15.739295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:15.740186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:15.741255 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:15.742007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:15.768146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=100 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:16.053816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:16.064135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-40570177-3981-4575-bfbe-b0c7c1910ce9 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.348795 Aug 02 09:46:16.080767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1671/3972] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:15 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:16.080767 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-80270d99-4684-40f8-9cc0-d5aa9568f25a req-e9ef7ba4-08fe-44cc-b296-2314d110ebe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8af50a-25b6-44bb-834c-2ef5fa62db09", "tag": "d4c5c62a-9bc2-465b-9f20-63acbc49f654"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:16.089529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-80270d99-4684-40f8-9cc0-d5aa9568f25a req-e9ef7ba4-08fe-44cc-b296-2314d110ebe1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:16.089987 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-80270d99-4684-40f8-9cc0-d5aa9568f25a req-e9ef7ba4-08fe-44cc-b296-2314d110ebe1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:16.104338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-80270d99-4684-40f8-9cc0-d5aa9568f25a req-e9ef7ba4-08fe-44cc-b296-2314d110ebe1 service nova] Creating event network-changed:d4c5c62a-9bc2-465b-9f20-63acbc49f654 for instance be8af50a-25b6-44bb-834c-2ef5fa62db09 on hv-cinder-80382 Aug 02 09:46:16.111216 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-80270d99-4684-40f8-9cc0-d5aa9568f25a req-e9ef7ba4-08fe-44cc-b296-2314d110ebe1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045148 Aug 02 09:46:16.112189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1672/3973] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:16.182219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:16.195138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:16.198176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:16.199621 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-31cd5e4f-9209-4a51-bacc-0956aabf747e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.520777 Aug 02 09:46:16.200726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2302/3974] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:15 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:16.222441 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:16.223046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:16.230104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:16.230711 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:16.231846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:16.232613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:16.491451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:16.499688 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-196e5732-69c4-4d6e-b00a-9635ab97a963 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1371 microversion: 2.1 time: 0.281592 Aug 02 09:46:16.513899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1673/3975] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:16 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:17.052283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-e7c2bc53-db10-465d-b60a-9ca4fb4deb5b req-90bd6c39-82c7-438c-a6f8-630b2fd35aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f0cb26-a5fc-4f18-9837-0c3537cfd024", "name": "network-vif-plugged", "status": "completed", "tag": "5bc5c237-d37f-4c27-88be-2cd5c6145db7"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:17.071088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-e7c2bc53-db10-465d-b60a-9ca4fb4deb5b req-90bd6c39-82c7-438c-a6f8-630b2fd35aab service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.072248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-e7c2bc53-db10-465d-b60a-9ca4fb4deb5b req-90bd6c39-82c7-438c-a6f8-630b2fd35aab service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.088510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:17.089957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:17.095659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:17.097730 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.098497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.099399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.100096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.103950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-e7c2bc53-db10-465d-b60a-9ca4fb4deb5b req-90bd6c39-82c7-438c-a6f8-630b2fd35aab service nova] Creating event network-vif-plugged:5bc5c237-d37f-4c27-88be-2cd5c6145db7 for instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 on hv-cinder-80382 Aug 02 09:46:17.114577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-e7c2bc53-db10-465d-b60a-9ca4fb4deb5b req-90bd6c39-82c7-438c-a6f8-630b2fd35aab service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065052 Aug 02 09:46:17.115224 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2303/3976] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:17.225355 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:17.226659 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:17.239843 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.240721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.241801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.242476 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.270791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:17.279144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-deb20bdc-90e5-443e-bde8-dc826ac0c751 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.195003 Aug 02 09:46:17.280081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1674/3977] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:17 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:17.408907 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:17.419016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:17.420547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:17.422326 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b9397fb9-f3db-4d8c-8827-4345bb39c311 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.201081 Aug 02 09:46:17.423023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2304/3978] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:17 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:46:17.521171 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:17.522197 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:17.529363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.530096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.530890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:17.531896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:17.741177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:17.752729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7032f16f-3b00-4e8b-b329-61ba8bcfd4f8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1371 microversion: 2.1 time: 0.234753 Aug 02 09:46:17.774532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1675/3979] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:17 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:18.301742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:18.302300 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:18.311438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:18.312223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:18.313767 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:18.314432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:18.446219 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:18.447322 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:18.450018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:18.464889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:18.466629 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:18.469947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:18.474230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:18.481319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:18.490595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-87793786-8308-4dd9-b25c-2339f383685d tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.192813 Aug 02 09:46:18.493129 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2305/3980] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:18 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:18.627394 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:18.637071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:18.638697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:18.640123 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f41fb381-05f0-4cf2-aad2-ac84783ddc8a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.197800 Aug 02 09:46:18.641283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1676/3981] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:18 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:18.776557 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:18.777605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:18.784821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:18.785315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:18.786087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:18.786708 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:18.787450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:19.041171 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:19.066370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fc387651-6981-46c1-ac92-62b45023447c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1371 microversion: 2.1 time: 0.293364 Aug 02 09:46:19.086071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2306/3982] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:18 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:19.514661 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:19.515959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:19.523407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:19.524360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:19.525237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:19.525909 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:19.667285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:19.668467 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:19.682055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:19.682931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:19.683964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:19.692240 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:19.756138 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:19.766372 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cc7c9c9b-ec94-4108-8797-78926ccddb40 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.255581 Aug 02 09:46:19.768616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1677/3983] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:19 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:19.943077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:19.957835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:19.959468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:19.963029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-93e8a647-f456-452f-9521-bbe310da4447 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.298345 Aug 02 09:46:19.963029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2307/3984] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:19 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:20.156464 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:20.157409 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:20.165977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:20.166430 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:20.167237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:20.167667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:20.324011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:20.336407 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7eba5f58-0153-49d0-93cd-6123442411dc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1562 microversion: 2.1 time: 0.184227 Aug 02 09:46:20.337437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1678/3985] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:20 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:20.357550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:20.358040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:20.364605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:20.365058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:20.365890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:20.366327 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:20.463219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e8d1b751-966e-4df8-aff2-aca26150f37b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109545 Aug 02 09:46:20.464328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2308/3986] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:46:20 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:20.803742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:20.804786 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:20.811586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:20.812104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:20.813270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:20.813790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:20.988045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:20.988662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:21.017325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:21.017800 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:21.018613 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:21.019062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:21.284556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:21.294747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:21.296836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:21.298450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1b44ad76-d6de-4bdb-b7f9-3d5a9d8ee22b tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.316721 Aug 02 09:46:21.299863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2309/3987] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:20 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:21.307199 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-c1f6ec8b-ed3a-4f42-a4cf-0adb8900fd15 req-023022a3-f8b0-4616-a04e-bbf5db8948cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8af50a-25b6-44bb-834c-2ef5fa62db09", "name": "network-vif-plugged", "status": "completed", "tag": "d4c5c62a-9bc2-465b-9f20-63acbc49f654"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:21.320909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-c1f6ec8b-ed3a-4f42-a4cf-0adb8900fd15 req-023022a3-f8b0-4616-a04e-bbf5db8948cb service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:21.321394 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-c1f6ec8b-ed3a-4f42-a4cf-0adb8900fd15 req-023022a3-f8b0-4616-a04e-bbf5db8948cb service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:21.337699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-c1f6ec8b-ed3a-4f42-a4cf-0adb8900fd15 req-023022a3-f8b0-4616-a04e-bbf5db8948cb service nova] Creating event network-vif-plugged:d4c5c62a-9bc2-465b-9f20-63acbc49f654 for instance be8af50a-25b6-44bb-834c-2ef5fa62db09 on hv-cinder-80382 Aug 02 09:46:21.343432 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-c1f6ec8b-ed3a-4f42-a4cf-0adb8900fd15 req-023022a3-f8b0-4616-a04e-bbf5db8948cb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041784 Aug 02 09:46:21.345387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2310/3988] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:21.513474 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:21.524855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c16ec0ec-f298-43e5-91d1-4248acb06a1e tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.724941 Aug 02 09:46:21.525966 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1679/3989] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:20 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:22.121548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-8ee84e7c-df53-42b5-b4f4-1dcce73b3792 req-4c271bdb-cf75-4984-aacd-3016c666c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f0cb26-a5fc-4f18-9837-0c3537cfd024", "tag": "5bc5c237-d37f-4c27-88be-2cd5c6145db7"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:22.132457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-8ee84e7c-df53-42b5-b4f4-1dcce73b3792 req-4c271bdb-cf75-4984-aacd-3016c666c5b3 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:22.132909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-8ee84e7c-df53-42b5-b4f4-1dcce73b3792 req-4c271bdb-cf75-4984-aacd-3016c666c5b3 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:22.147785 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-8ee84e7c-df53-42b5-b4f4-1dcce73b3792 req-4c271bdb-cf75-4984-aacd-3016c666c5b3 service nova] Creating event network-changed:5bc5c237-d37f-4c27-88be-2cd5c6145db7 for instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 on hv-cinder-80382 Aug 02 09:46:22.153145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-8ee84e7c-df53-42b5-b4f4-1dcce73b3792 req-4c271bdb-cf75-4984-aacd-3016c666c5b3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036863 Aug 02 09:46:22.154221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2311/3990] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:22.324855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:22.325598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:22.328691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:22.329619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=14 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:22.336113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:22.336735 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:22.337551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:22.337994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:22.475426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:22.483442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:22.485763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:22.487021 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-325a8aa8-c626-43b5-b623-f3e3930e7403 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1745 microversion: 2.20 time: 0.166192 Aug 02 09:46:22.487974 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1680/3991] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:22 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:22.549732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:22.550430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:22.556605 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:22.557053 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:22.557864 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:22.558301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:22.701133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:22.712273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c5fe80e5-5dff-4a45-9d76-a17b7d793d11 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1323 microversion: 2.1 time: 0.168070 Aug 02 09:46:22.712861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2312/3992] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:22 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1323 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:23.511959 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:23.512574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:23.520879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:23.521362 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:23.522144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:23.522586 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:23.733721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:23.734686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:23.739740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:23.741473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:23.742132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:23.743093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:23.743700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:23.751106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:23.752925 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:23.754523 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-38e70e9d-51c1-4d63-9737-df6816237396 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1727 microversion: 2.20 time: 0.246534 Aug 02 09:46:23.766496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1681/3993] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:23 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1727 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:23.953595 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:23.961663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8edaa279-cfd7-42dc-9543-80e359e2c942 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1513 microversion: 2.1 time: 0.231816 Aug 02 09:46:23.962254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2313/3994] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:23 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:23.983479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f94dfa8c-6ef0-4297-9b9f-8fbafb37d401", "device": "/dev/sdb"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:23.987150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:23.993578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:23.994451 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:23.994981 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:23.995485 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:24.324191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eb697621-1bbb-4f92-8de4-5485395b32fe tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "POST /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345725 Aug 02 09:46:24.324839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1682/3995] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:46:23 2022] POST /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:46:24.780400 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:24.781143 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:24.787692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:24.788138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:24.788904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:24.789367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:24.922836 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:24.931123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:24.932674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:24.933872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-56792315-bc24-4810-a27b-d87a5b419101 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1727 microversion: 2.20 time: 0.157475 Aug 02 09:46:24.934762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2314/3996] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:24 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:24.988231 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-63916f18-999c-4192-83ee-6c65f54258e1 req-6cfd266e-025e-466b-9486-b4f75cd1b08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "name": "network-vif-unplugged", "status": "completed", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:24.999222 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-63916f18-999c-4192-83ee-6c65f54258e1 req-6cfd266e-025e-466b-9486-b4f75cd1b08f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:24.999855 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-63916f18-999c-4192-83ee-6c65f54258e1 req-6cfd266e-025e-466b-9486-b4f75cd1b08f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:25.013329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-63916f18-999c-4192-83ee-6c65f54258e1 req-6cfd266e-025e-466b-9486-b4f75cd1b08f service nova] Creating event network-vif-unplugged:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:46:25.018977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-63916f18-999c-4192-83ee-6c65f54258e1 req-6cfd266e-025e-466b-9486-b4f75cd1b08f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035139 Aug 02 09:46:25.019591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1683/3997] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:25.957802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:25.959018 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:25.966011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:25.966464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:25.967250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:25.967715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:26.112782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:26.121140 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:26.124125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:26.124125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-afdff5d1-64a1-48b1-bb6c-ea88f082c189 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1730 microversion: 2.20 time: 0.170477 Aug 02 09:46:26.124402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2315/3998] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:25 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:26.147503 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81dfc37e-f7da-4c54-aa27-f7df0eaa487b"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:26.150100 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:26.157545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:26.157991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:26.158757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:26.159190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:26.539520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3c919960-da72-42ae-9372-b2d20118239e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396429 Aug 02 09:46:26.540440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1684/3999] 10.222.0.100 () {62 vars in 1369 bytes} [Tue Aug 2 09:46:26 2022] POST /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-volume_attachments => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:46:26.694623 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:26.695155 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:26.701719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:26.702168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:26.703284 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:26.703868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:26.969840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-81b239dd-fe19-4f3d-b14d-ac2206c4592f tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-volume_attachments/81dfc37e-f7da-4c54-aa27-f7df0eaa487b" status: 202 len: 0 microversion: 2.20 time: 0.279583 Aug 02 09:46:26.970581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2316/4000] 10.222.0.100 () {60 vars in 1462 bytes} [Tue Aug 2 09:46:26 2022] DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-volume_attachments/81dfc37e-f7da-4c54-aa27-f7df0eaa487b => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:46:27.030790 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:27.031385 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:27.038080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:27.038528 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:27.039288 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:27.039833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:27.053737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:27.083851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117909) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:46:27.151928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2b7d5ad0-85d9-42b2-b6b1-35148549d2b1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "POST /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/action" status: 202 len: 0 microversion: 2.20 time: 0.124884 Aug 02 09:46:27.152766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1685/4001] 10.222.0.100 () {62 vars in 1324 bytes} [Tue Aug 2 09:46:27 2022] POST /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:46:27.160786 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:27.161430 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:27.167484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:27.167942 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:27.168703 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:27.169158 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:27.306437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:27.315676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:27.317220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:27.318401 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-16f1fe7a-c523-48ce-a437-06cace69fcfa tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1678 microversion: 2.20 time: 0.161508 Aug 02 09:46:27.318972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2317/4002] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:27 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:28.342083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:28.342780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:28.349674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:28.350119 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:28.350880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:28.351340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:28.496847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:28.505534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:28.507721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:28.508927 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c57437df-d465-4e3e-840b-599e2aa01470 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1680 microversion: 2.20 time: 0.170683 Aug 02 09:46:28.509492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1686/4003] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:28 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:29.533128 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:29.533758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:29.540275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:29.540753 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:29.541540 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:29.541969 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:29.680591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:29.692444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:29.695410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:29.697586 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-181afbc5-7ae9-4ad0-a72c-6d693980b7db tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.168054 Aug 02 09:46:29.698663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2318/4004] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:29 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:30.722018 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:30.722714 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:30.729578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:30.731679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:30.731679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:30.731679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:30.937482 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:30.946757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:30.948284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:30.949502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-77720594-24b1-4ee8-a8a4-0c1012412775 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.231430 Aug 02 09:46:30.950072 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1687/4005] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:30 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:31.977209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:31.977910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:31.984816 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:31.985315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:31.986108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:31.986550 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:32.006818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:32.128434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:32.138116 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:32.139705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:32.142260 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3defd029-ff0e-4030-92d8-36de658f328d tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.170000 Aug 02 09:46:32.142840 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2319/4006] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:31 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:33.167196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:33.167903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:33.175875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:33.176284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:33.177064 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:33.177526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:33.320724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:33.329687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:33.331214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:33.332398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13f53cf6-25c3-496d-8e10-f49162778ce8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.169631 Aug 02 09:46:33.332954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1688/4007] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:33 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:34.361481 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:34.362887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:34.369924 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:34.370462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:34.371310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:34.371976 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:34.535853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:34.547241 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:34.549624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:34.551412 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b70dfe3f-2f6d-4a86-aeaf-88441124f580 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.195531 Aug 02 09:46:34.552195 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2320/4008] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:34 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:35.579892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:35.580898 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:35.588972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:35.589456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:35.590373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:35.590804 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:35.783136 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:35.792324 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:35.794200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:35.795618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8d78a521-7250-48ce-80c3-ebd0c1db94a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.221752 Aug 02 09:46:35.801342 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1689/4009] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:35 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:36.822113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:36.823548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:36.826746 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:36.834879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:36.846938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:36.846938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:36.846938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:37.012250 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:37.021516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:37.023008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:37.024184 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c90eb75d-f219-41f8-a752-518a7894bbf3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.206856 Aug 02 09:46:37.025041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2321/4010] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:36 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:38.056955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:38.056955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:38.056955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:38.056955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:38.058697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:38.058697 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:38.202158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:38.211053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:38.212581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:38.213933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-330c83ba-021a-4318-8525-3d2e412563fd tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.170217 Aug 02 09:46:38.214505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1690/4011] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:38 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:39.239182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:39.239782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:39.246533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:39.247028 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:39.247763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:39.248192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:39.393015 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:39.401468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:39.403007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:39.404204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1359656b-1cc2-4c6a-922c-7aab5d2539b4 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.169147 Aug 02 09:46:39.404762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2322/4012] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:39 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:46:40.427841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:40.428488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:40.438156 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:40.438910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:40.439696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:40.440392 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:40.580838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:40.589120 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:40.590670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:40.591847 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bc777848-5c1b-4971-80e5-2043dc410a65 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.168016 Aug 02 09:46:40.592421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1691/4013] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:40 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:41.615000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:41.615664 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:41.622523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:41.622960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:41.624360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:41.625007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:41.758719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:41.767086 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:41.768608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:41.769826 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5a171532-3b37-43ec-85e4-6fd506a57b62 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.158806 Aug 02 09:46:41.770396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2323/4014] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:41 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:42.791969 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:42.792603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:42.799301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:42.799757 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:42.800613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:42.801144 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:42.942828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:42.956826 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:42.958492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:42.959700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b0799a53-57d4-4b6f-9acb-535c5fcbde1e tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.171832 Aug 02 09:46:42.960273 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1692/4015] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:42 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:43.983637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:43.984414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:43.991092 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:43.991544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:43.992312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:43.992749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:44.127312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:44.135749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:44.137386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:44.138617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-68c89234-84d2-44ac-85ce-37865bc8b094 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.159495 Aug 02 09:46:44.139218 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2324/4016] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:43 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:45.161533 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:45.162141 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:45.168912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:45.169395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:45.170169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:45.170610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:45.308150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:45.315982 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:45.317506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:45.318768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-168a3a5e-8238-4845-a17d-80f1fd072152 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.161180 Aug 02 09:46:45.319327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1693/4017] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:45 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:46.342423 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:46.343186 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:46.349863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:46.350319 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:46.351107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:46.351545 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:46.488635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:46.497044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:46.498648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:46.500318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-40064fc6-e2bf-45ef-ada8-12de2f2445f2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.162088 Aug 02 09:46:46.500887 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2325/4018] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:46 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:47.272540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-811a0fab-e7de-4a51-a790-684859f2c3a8 req-62d701e7-5fca-41a7-9daf-ef63a14b90f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "name": "network-vif-plugged", "status": "completed", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:47.283677 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-811a0fab-e7de-4a51-a790-684859f2c3a8 req-62d701e7-5fca-41a7-9daf-ef63a14b90f2 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:47.284172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-811a0fab-e7de-4a51-a790-684859f2c3a8 req-62d701e7-5fca-41a7-9daf-ef63a14b90f2 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:47.300616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-811a0fab-e7de-4a51-a790-684859f2c3a8 req-62d701e7-5fca-41a7-9daf-ef63a14b90f2 service nova] Creating event network-vif-plugged:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:46:47.305872 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-811a0fab-e7de-4a51-a790-684859f2c3a8 req-62d701e7-5fca-41a7-9daf-ef63a14b90f2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036964 Aug 02 09:46:47.306733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1694/4019] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:46:47.524370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:47.525850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:47.533682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:47.534137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:47.535666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:47.535666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:47.716302 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:47.725242 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:47.726762 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:47.727949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a07ebfbc-ea38-4366-87ea-6ecc3b3b66e6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.207795 Aug 02 09:46:47.728523 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2326/4020] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:47 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:46:48.752887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:48.753678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:48.756057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:48.761700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:48.762154 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:48.762933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:48.763376 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:48.898418 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:48.906850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:48.908395 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:48.909594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a553948a-0360-4fb7-89ea-747bf5ee0578 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.161611 Aug 02 09:46:48.910150 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1695/4021] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:48 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:49.932596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:49.933244 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:49.939992 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:49.940435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:49.941236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:49.941682 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:50.081819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:50.089929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:50.091426 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:50.093193 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0a390ecf-0cf8-4597-a7ad-0f35532d0111 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.164052 Aug 02 09:46:50.093757 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2327/4022] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:49 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:51.115854 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:51.116463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:51.123168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:51.124304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:51.125126 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:51.125560 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:51.268922 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:51.277319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:51.278831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:51.280341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ab1242d9-1474-4720-909f-b1b9fe253785 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.168284 Aug 02 09:46:51.280912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1696/4023] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:51 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:52.305315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:52.306037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:52.318856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:52.318856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:52.318856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:52.318856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:52.488204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:52.497003 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:52.499201 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:52.500407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f680e841-9ce4-40aa-b2c6-76cc228d95a1 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1736 microversion: 2.20 time: 0.200746 Aug 02 09:46:52.501211 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2328/4024] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:52 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:53.523712 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:53.524321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:53.530956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:53.531408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:53.532169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:53.532604 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:53.675140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:53.683260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:53.684870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:53.686983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c593be28-b067-45ef-aa9a-bb5a2fa4a551 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1723 microversion: 2.20 time: 0.166481 Aug 02 09:46:53.687445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1697/4025] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:46:53 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:46:55.604596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:55.605178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:55.612721 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:55.613200 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:55.613974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:55.614406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:55.705187 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lazy-loading 'services' on Instance uuid be8af50a-25b6-44bb-834c-2ef5fa62db09 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:46:55.794259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-39f88fc6-595c-45ca-be83-650a73ce4471 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09/os-volume_attachments/f94dfa8c-6ef0-4297-9b9f-8fbafb37d401" status: 202 len: 0 microversion: 2.1 time: 0.193475 Aug 02 09:46:55.795181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2329/4026] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:46:55 2022] DELETE /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09/os-volume_attachments/f94dfa8c-6ef0-4297-9b9f-8fbafb37d401 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:46:56.946492 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:56.947074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:56.954561 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:56.955009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:56.955833 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:56.956275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:56.988601 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:46:57.091574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-2140b4df-dda1-4f2a-a307-5a5e0dd8ad42 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "DELETE /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 204 len: 0 microversion: 2.1 time: 0.148786 Aug 02 09:46:57.093177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1698/4027] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:46:56 2022] DELETE /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:46:57.103519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:57.104220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:57.111548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:57.111994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:57.112764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:57.113232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:57.265183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:57.273229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-177f6121-262d-4278-a6f2-952a25ffe133 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1519 microversion: 2.1 time: 0.174891 Aug 02 09:46:57.273847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2330/4028] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:57 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:58.298213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:58.298935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:58.305704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:58.306158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:58.306954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:58.307399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:58.310541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:46:58.457768 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:58.465764 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c1da8526-3950-43a6-a783-f7d809751f82 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1519 microversion: 2.1 time: 0.172393 Aug 02 09:46:58.466319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1699/4029] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:58 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:46:59.488324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:46:59.488951 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:46:59.496288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:59.496755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:59.499480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:59.499480 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:59.741573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b074a126a458485e882a9e9eea178dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0ba64c011a419b9cc8f5501a8606ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:46:59.750369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4a4f0bdd-5cfb-47b1-b726-877fd3f14f8f tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 200 len: 1519 microversion: 2.1 time: 0.265954 Aug 02 09:46:59.750986 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2331/4030] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:46:59 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:46:59.903402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-e7bdde29-43a7-42d7-ba3e-7bcacf57d3f1 req-e5ed4707-ea31-49f9-bbe1-6d1214c435cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8af50a-25b6-44bb-834c-2ef5fa62db09", "name": "network-vif-deleted", "tag": "d4c5c62a-9bc2-465b-9f20-63acbc49f654"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:46:59.919301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-e7bdde29-43a7-42d7-ba3e-7bcacf57d3f1 req-e5ed4707-ea31-49f9-bbe1-6d1214c435cb service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:46:59.919696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-e7bdde29-43a7-42d7-ba3e-7bcacf57d3f1 req-e5ed4707-ea31-49f9-bbe1-6d1214c435cb service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:46:59.931593 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-e7bdde29-43a7-42d7-ba3e-7bcacf57d3f1 req-e5ed4707-ea31-49f9-bbe1-6d1214c435cb service nova] Creating event network-vif-deleted:d4c5c62a-9bc2-465b-9f20-63acbc49f654 for instance be8af50a-25b6-44bb-834c-2ef5fa62db09 on hv-cinder-80382 Aug 02 09:46:59.936774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-e7bdde29-43a7-42d7-ba3e-7bcacf57d3f1 req-e5ed4707-ea31-49f9-bbe1-6d1214c435cb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040719 Aug 02 09:46:59.937491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1700/4031] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:00.771499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:00.772136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] [instance: be8af50a-25b6-44bb-834c-2ef5fa62db09] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:00.778852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:00.779833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:00.780604 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:00.781131 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:00.795431 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] HTTP exception thrown: Instance be8af50a-25b6-44bb-834c-2ef5fa62db09 could not be found. Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Request method failure captured: Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 HTTP/1.1 Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OrBbXQT6w9KWeJUL4oubAeDsAtyDgHUObpC9_-kPsT5NVF36lVkd2QVlVcnlJDGXNOUpIffw_SfFGZDsJrHucUg0I6atgnquvjPSspWWPJVbg9gOY9Vf82XJcO2Wox8afdXMelsYuxR0Wi4WzfpGNrv5oCndMBAdA4l81YeIDoYL9g Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:00.797163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0d0ba64c011a419b9cc8f5501a8606ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0d0ba64c011a419b9cc8f5501a8606ac Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1960892002 Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: b074a126a458485e882a9e9eea178dca Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotTestJSON-1960892002-project Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance be8af50a-25b6-44bb-834c-2ef5fa62db09 could not be found. Aug 02 09:47:00.799137 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'be8af50a-25b6-44bb-834c-2ef5fa62db09'} Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8af50a-25b6-44bb-834c-2ef5fa62db09 could not be found. Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:00.800387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8af50a-25b6-44bb-834c-2ef5fa62db09 could not be found. Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8af50a-25b6-44bb-834c-2ef5fa62db09 could not be found. Aug 02 09:47:00.802528 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:00.804134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] Returning 404 to user: Instance be8af50a-25b6-44bb-834c-2ef5fa62db09 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:00.804134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f020b0c6-4019-4bbc-b5f7-498faf46c634 tempest-VolumesSnapshotTestJSON-1960892002 tempest-VolumesSnapshotTestJSON-1960892002-project] 10.222.0.100 "GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09" status: 404 len: 111 microversion: 2.1 time: 0.030995 Aug 02 09:47:00.804134 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2332/4032] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:00 2022] GET /compute/v2.1/servers/be8af50a-25b6-44bb-834c-2ef5fa62db09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:08.839808 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:08.840413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:08.846646 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:08.847125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:08.847885 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:08.848325 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:08.871157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-60e79208-e131-4b27-920c-ba55c1e1777b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/ips" status: 200 len: 150 microversion: 2.1 time: 0.036294 Aug 02 09:47:08.871723 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1701/4033] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:47:08 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:10.214371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2711cfd-50fc-4133-a82f-266d56f2bcb0"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:47:10.216851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:10.219509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=24 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:47:10.224964 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:10.225445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:10.226217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:10.226660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:10.229243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:47:10.552025 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ded95193-ce15-4149-95ab-f3c4f989fc3d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "POST /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341364 Aug 02 09:47:10.552862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2333/4034] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:47:10 2022] POST /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:21.377895 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:21.378431 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:21.380887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:47:21.381859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=11 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:47:21.388303 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:21.388853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:21.389644 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:21.390127 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:21.480778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lazy-loading 'services' on Instance uuid 56f0cb26-a5fc-4f18-9837-0c3537cfd024 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:47:21.553075 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ceecf91d-5893-40f3-82f5-c9664f1a466e tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments/c2711cfd-50fc-4133-a82f-266d56f2bcb0" status: 202 len: 0 microversion: 2.1 time: 0.178978 Aug 02 09:47:21.553694 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1702/4035] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:47:21 2022] DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments/c2711cfd-50fc-4133-a82f-266d56f2bcb0 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:47:21.560438 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:47:21.561264 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:47:21.565536 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:21.567919 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:21.575974 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:21.576445 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:21.577278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:21.577723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:21.608818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-250403da-31aa-48e9-8444-f68e3fc94269 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050357 Aug 02 09:47:21.609422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2334/4036] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:47:21 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:22.623658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:22.625850 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:22.632353 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:22.632802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:22.633598 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:22.634062 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:22.664190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8c11f08c-ef1e-48d1-b2a2-67e3b425abf2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046369 Aug 02 09:47:22.664753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1703/4037] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:47:22 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:47:22.726794 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:22.727320 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:22.734177 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:22.734619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:22.735371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:22.735802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:22.764144 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:47:22.841439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0dc8c2d6-75a0-4d4b-8867-ee1a411a203f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 204 len: 0 microversion: 2.1 time: 0.118285 Aug 02 09:47:22.842615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2335/4038] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:47:22 2022] DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:47:22.850264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:22.850870 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:22.857400 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:22.857875 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:22.858626 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:22.859077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:22.996253 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:23.005637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e459f6d8-1316-4798-8d6b-08d21ca41218 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1686 microversion: 2.1 time: 0.159123 Aug 02 09:47:23.006633 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1704/4039] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:22 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:47:24.029179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:24.029970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:24.036626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:24.037058 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:24.037859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:24.038301 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:24.187918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:24.195469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-15730eef-c25d-4e30-953a-a9aa865e36a8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1686 microversion: 2.1 time: 0.171260 Aug 02 09:47:24.196041 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2336/4040] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:24 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:47:25.216516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:25.217226 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:25.226540 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:25.226877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:25.232161 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:25.232657 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:25.329670 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:25.337647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fb1c10b6-69fd-461b-b41b-a40818e5d5d2 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1619 microversion: 2.1 time: 0.125667 Aug 02 09:47:25.338258 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1705/4041] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:25 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1619 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:47:25.835748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-8828fa12-45a6-4840-9ca0-add9eaaaf1fd req-90555b18-6c11-4c55-8744-c255cd28a90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f0cb26-a5fc-4f18-9837-0c3537cfd024", "name": "network-vif-deleted", "tag": "5bc5c237-d37f-4c27-88be-2cd5c6145db7"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:47:25.849861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-8828fa12-45a6-4840-9ca0-add9eaaaf1fd req-90555b18-6c11-4c55-8744-c255cd28a90b service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:25.850448 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-8828fa12-45a6-4840-9ca0-add9eaaaf1fd req-90555b18-6c11-4c55-8744-c255cd28a90b service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:25.864130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-8828fa12-45a6-4840-9ca0-add9eaaaf1fd req-90555b18-6c11-4c55-8744-c255cd28a90b service nova] Creating event network-vif-deleted:5bc5c237-d37f-4c27-88be-2cd5c6145db7 for instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 on hv-cinder-80382 Aug 02 09:47:25.870666 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-8828fa12-45a6-4840-9ca0-add9eaaaf1fd req-90555b18-6c11-4c55-8744-c255cd28a90b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038359 Aug 02 09:47:25.871592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2337/4042] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:26.360330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:26.360956 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:26.367609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:26.368274 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:26.369281 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:26.369899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:26.405734 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:26.406191 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:26.406821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lazy-loading 'fault' on Instance uuid 56f0cb26-a5fc-4f18-9837-0c3537cfd024 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:47:26.453574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9633b9cbd8a4332a605ca66d73dc5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05905727ed6c41a1b6187fec6e61dd8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:26.469596 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47caaf0b-89e2-4831-8dbc-4904160f712b tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 200 len: 1336 microversion: 2.1 time: 0.113449 Aug 02 09:47:26.470645 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1706/4043] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:26 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:47:27.492416 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:27.493130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:27.499832 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:27.500283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:27.501049 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:27.501515 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:27.515697 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 HTTP/1.1 Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:27.517397 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:27.519203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '56f0cb26-a5fc-4f18-9837-0c3537cfd024'} Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:27.524101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:27.526626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:27.529027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:27.529027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7a784d2f-3c34-47d5-8098-c52c468c0eea tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 404 len: 111 microversion: 2.1 time: 0.030814 Aug 02 09:47:27.529027 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2338/4044] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:27 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:27.529347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-90bb8b6c-3f00-460b-b227-2dbaba19686f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '.version_select at 0x7f8c184f2790>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:27.551218 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-90bb8b6c-3f00-460b-b227-2dbaba19686f tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121580387" status: 202 len: 0 microversion: 2.1 time: 0.027033 Aug 02 09:47:27.551835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1707/4045] 10.222.0.100 () {58 vars in 1226 bytes} [Tue Aug 2 09:47:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121580387 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:47:29.374357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:29.374918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:29.381915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:29.382389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:29.383142 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:29.383576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:29.397750 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 HTTP/1.1 Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:29.399310 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.401105 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '56f0cb26-a5fc-4f18-9837-0c3537cfd024'} Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:29.402575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.404906 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.406768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:29.406768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ab819ae5-95b9-4343-ba87-c152094472cc tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 404 len: 111 microversion: 2.1 time: 0.030399 Aug 02 09:47:29.406768 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2339/4046] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:47:29 2022] DELETE /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:29.409937 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:29.410581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 56f0cb26-a5fc-4f18-9837-0c3537cfd024] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:29.417849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:29.418291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:29.419599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:29.420030 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:29.432935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 HTTP/1.1 Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:29.434879 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.436931 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '56f0cb26-a5fc-4f18-9837-0c3537cfd024'} Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:29.438035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. Aug 02 09:47:29.439665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:29.441103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 56f0cb26-a5fc-4f18-9837-0c3537cfd024 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:29.441103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-5c6780bd-2096-4c68-8024-d4de2b2b1ad8 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024" status: 404 len: 111 microversion: 2.1 time: 0.030138 Aug 02 09:47:29.441103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1708/4047] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:29 2022] GET /compute/v2.1/servers/56f0cb26-a5fc-4f18-9837-0c3537cfd024 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:30.581362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:30.581362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:30.585071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.585547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.586318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.586754 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.601337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 HTTP/1.1 Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:30.602886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.604726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '2c68e4ad-23db-4b96-8dac-dbbc3fcbd314'} Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:30.605982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.607634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.609350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:30.609350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-aa387040-b8ad-4f04-b1eb-b710994d5a7d tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 404 len: 111 microversion: 2.1 time: 0.030794 Aug 02 09:47:30.609350 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2340/4048] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:47:30 2022] DELETE /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:30.613797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:30.614419 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:30.620527 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.620983 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.621852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.622292 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.635993 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 HTTP/1.1 Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:30.638186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.640007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '2c68e4ad-23db-4b96-8dac-dbbc3fcbd314'} Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:30.641187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. Aug 02 09:47:30.642928 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.644498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:30.644498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98dc080d-07a5-49f0-a67c-b6f0f69ef904 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314" status: 404 len: 111 microversion: 2.1 time: 0.029691 Aug 02 09:47:30.644498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1709/4049] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:30 2022] GET /compute/v2.1/servers/2c68e4ad-23db-4b96-8dac-dbbc3fcbd314 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:30.648204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:30.648700 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:30.655589 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.656040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.656801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.657274 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.670483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 HTTP/1.1 Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:30.672013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.673904 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'ddaf95ef-cb6f-4ed0-a20d-a4df82191123'} Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:30.675145 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.676818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.678597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:30.678597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2fa6d617-80b6-460a-a526-99bf95dfcffe tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 404 len: 111 microversion: 2.1 time: 0.029008 Aug 02 09:47:30.678597 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2341/4050] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:47:30 2022] DELETE /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:30.681759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:30.682383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: ddaf95ef-cb6f-4ed0-a20d-a4df82191123] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:30.688609 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.689063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.689860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:30.690304 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:30.704259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 HTTP/1.1 Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:30.705845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.707608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'ddaf95ef-cb6f-4ed0-a20d-a4df82191123'} Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:30.708617 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. Aug 02 09:47:30.710387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:30.712040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance ddaf95ef-cb6f-4ed0-a20d-a4df82191123 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:30.712040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d241d899-d38e-4738-b7ed-c6f54fabad4c tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123" status: 404 len: 111 microversion: 2.1 time: 0.029325 Aug 02 09:47:30.712040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1710/4051] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:30 2022] GET /compute/v2.1/servers/ddaf95ef-cb6f-4ed0-a20d-a4df82191123 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:31.846012 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:31.846498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:31.853182 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:31.853640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:31.854410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:31.854850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:31.869054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 HTTP/1.1 Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:31.870684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.873008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '02e2d9a6-78b8-4f7a-8216-490f423ba511'} Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:31.876945 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.878830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.880456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:31.880456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bf10512e-d844-4201-9a46-16dbba7dc6f0 tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 404 len: 111 microversion: 2.1 time: 0.030571 Aug 02 09:47:31.880456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2342/4052] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:47:31 2022] DELETE /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:31.884606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:31.885254 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] [instance: 02e2d9a6-78b8-4f7a-8216-490f423ba511] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:31.892356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:31.892818 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:31.893637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:31.894078 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:31.908158 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] HTTP exception thrown: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Request method failure captured: Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 HTTP/1.1 Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Ooz5-4tlgrvuGyzqdEx3tdJ2XxnMpqO1yL9ZZHAtTGoXkPiDJceP3oI2Zk-gFXK-UzjY7CdWtOsbB8VNz-urX14nTcoMFE3yvGfa622Ovz0CEdcF6Oi2QTJdYwcePClorb7rL_gWteAc0WBDFgYndm5If5t35maHIhwLMryA969pj0 Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:31.909829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/05905727ed6c41a1b6187fec6e61dd8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 05905727ed6c41a1b6187fec6e61dd8f Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-575750223 Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: c9633b9cbd8a4332a605ca66d73dc5b1 Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeNegativeTest-575750223-project Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.911776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '02e2d9a6-78b8-4f7a-8216-490f423ba511'} Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:31.912748 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. Aug 02 09:47:31.914433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:31.915913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] Returning 404 to user: Instance 02e2d9a6-78b8-4f7a-8216-490f423ba511 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:31.915913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4fd07943-ce0a-48ff-aef6-8c88f9f3a3bf tempest-AttachVolumeNegativeTest-575750223 tempest-AttachVolumeNegativeTest-575750223-project] 10.222.0.100 "GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511" status: 404 len: 111 microversion: 2.1 time: 0.033809 Aug 02 09:47:31.915913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1711/4053] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:47:31 2022] GET /compute/v2.1/servers/02e2d9a6-78b8-4f7a-8216-490f423ba511 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:34.977076 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:34.979237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:34.986596 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:34.987042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:34.987801 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:34.988233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:35.019469 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f0cbdc3e-82e6-400c-bbaf-d8cc17c92fa9 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046945 Aug 02 09:47:35.020044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2343/4054] 10.222.0.100 () {60 vars in 1348 bytes} [Tue Aug 2 09:47:34 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:47:35.102718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:35.103230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:35.110950 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:35.111461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:35.112179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:35.112621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:35.140111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Going to try to terminate instance {{(pid=117909) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:47:35.236673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-348c3083-ff5c-46e1-94e6-5cc922f9e529 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 204 len: 0 microversion: 2.20 time: 0.137492 Aug 02 09:47:35.237415 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1712/4055] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:47:35 2022] DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:47:35.256915 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:35.257901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:35.268601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:35.269050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:35.269859 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:35.270294 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:35.441822 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:35.450509 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:35.452032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:35.453249 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0bab58bb-c189-48b6-ae4c-b6ccc33f08b8 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.200507 Aug 02 09:47:35.453819 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2344/4056] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:47:35 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:47:36.479051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:36.479738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:36.485985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:36.486472 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:36.487247 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:36.487686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:36.570625 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7e863e02-577c-4dfa-96ba-ec0db199e493 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Action: 'create', calling method: .version_select at 0x7f8c1821a8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1653505985"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:47:36.622081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:36.630643 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:36.632910 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:36.634446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-32233ffc-c19b-4238-a80b-d7f1288519c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1729 microversion: 2.20 time: 0.159212 Aug 02 09:47:36.635081 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2345/4057] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:47:36 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:47:36.876134 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7e863e02-577c-4dfa-96ba-ec0db199e493 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.423856 Aug 02 09:47:36.876762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1713/4058] 10.222.0.100 () {60 vars in 1160 bytes} [Tue Aug 2 09:47:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 02 09:47:36.890280 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-6805b7bb-4810-4d56-b67a-1b92f2b66e25 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c18150e50>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:36.959425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-6805b7bb-4810-4d56-b67a-1b92f2b66e25 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 200 len: 345 microversion: 2.1 time: 0.073931 Aug 02 09:47:36.960001 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2346/4059] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:47:36 2022] GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:37.598792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-0fc82eff-c09c-40ce-af5a-b4cb07e3ab83 req-b9c66eeb-71e8-4f6e-904f-3ae8bd876a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c0537f-91ad-4f13-ad40-d178194a1d43", "name": "network-vif-deleted", "tag": "90d808ed-b7ab-417a-a9ae-659c9b7ad010"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:47:37.610513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-0fc82eff-c09c-40ce-af5a-b4cb07e3ab83 req-b9c66eeb-71e8-4f6e-904f-3ae8bd876a93 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:37.610954 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-0fc82eff-c09c-40ce-af5a-b4cb07e3ab83 req-b9c66eeb-71e8-4f6e-904f-3ae8bd876a93 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:37.624081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-0fc82eff-c09c-40ce-af5a-b4cb07e3ab83 req-b9c66eeb-71e8-4f6e-904f-3ae8bd876a93 service nova] Creating event network-vif-deleted:90d808ed-b7ab-417a-a9ae-659c9b7ad010 for instance d6c0537f-91ad-4f13-ad40-d178194a1d43 on hv-cinder-80382 Aug 02 09:47:37.629892 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-0fc82eff-c09c-40ce-af5a-b4cb07e3ab83 req-b9c66eeb-71e8-4f6e-904f-3ae8bd876a93 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035340 Aug 02 09:47:37.630498 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1714/4060] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:37.659474 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:37.660952 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:37.668016 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:37.669609 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:37.670870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:37.671322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:37.745425 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:37.756921 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:37.758736 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e93d159e8644203808918c5ae86fc74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada46409d8ae4abfaf19056675f7fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:47:37.760230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-322d9327-0e08-4fca-a804-9b2ab4dffdc6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 200 len: 1371 microversion: 2.20 time: 0.105156 Aug 02 09:47:37.760773 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2347/4061] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:47:37 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:47:37.977516 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-30dd281f-2c62-4050-9a87-c17a9c5ea2e8 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1808c820>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:38.027520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-30dd281f-2c62-4050-9a87-c17a9c5ea2e8 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 200 len: 346 microversion: 2.1 time: 0.055113 Aug 02 09:47:38.028605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1715/4062] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:47:37 2022] GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:38.041149 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-42b61de6-c81e-42de-8823-cc4d5f29beb2 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Action: 'create', calling method: .version_select at 0x7f8c18101430>, body: {"snapshot": {"volume_id": "b5c67b57-f583-4c71-b9cf-d71af502b35a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1531683859"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:47:38.218587 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-42b61de6-c81e-42de-8823-cc4d5f29beb2 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.181322 Aug 02 09:47:38.219687 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2348/4063] 10.222.0.100 () {60 vars in 1167 bytes} [Tue Aug 2 09:47:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:38.232277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f406c2de-5664-4ca0-9f47-5cebc4be37e5 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c183af940>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:38.282556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f406c2de-5664-4ca0-9f47-5cebc4be37e5 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 287 microversion: 2.1 time: 0.055733 Aug 02 09:47:38.283140 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1716/4064] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:38 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:38.295454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-066922b7-2e4a-403e-8820-f1ed29fd8f6b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c180894c0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:38.333676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-066922b7-2e4a-403e-8820-f1ed29fd8f6b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.042885 Aug 02 09:47:38.334257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2349/4065] 10.222.0.100 () {58 vars in 1145 bytes} [Tue Aug 2 09:47:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:47:38.346396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3580192c-1bb2-40ba-8d7b-4287647eb82f tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c181921f0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:38.379259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3580192c-1bb2-40ba-8d7b-4287647eb82f tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 287 microversion: 2.1 time: 0.037204 Aug 02 09:47:38.379823 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1717/4066] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:38 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:38.785856 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:38.786485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:38.792835 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:38.793968 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:38.794875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:38.795100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:38.810216 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] HTTP exception thrown: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Request method failure captured: Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 HTTP/1.1 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oouc7JQ4CTMM00_Rfdj1e1P6EJk55bwSCzJ2jO0VH01BeeOSCeJ0MH3wnE81X6tOpRR569C0JNfq7Imgb1gQ3X0ToSoV4XtJBFvojbzLJlNGizTi0Ul9KjCR38bfn8jmAnZN3BBMh04MT4RsxT-Yqgu8qk8CxbMedUcDUvmwfwRtS8 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:38.811782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 0e93d159e8644203808918c5ae86fc74 Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:38.813702 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'd6c0537f-91ad-4f13-ad40-d178194a1d43'} Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:38.814883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:38.816655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:38.818626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Returning 404 to user: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:38.818626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e21d2733-43ed-49d7-976d-772a077f81c2 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 404 len: 111 microversion: 2.20 time: 0.032653 Aug 02 09:47:38.818626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2350/4067] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:47:38 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:47:38.823036 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ecdb82e9-ce94-444e-bd45-27bc7e0435ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '.version_select at 0x7f8c18038700>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:38.843742 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ecdb82e9-ce94-444e-bd45-27bc7e0435ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998615020" status: 204 len: 0 microversion: 2.20 time: 0.025009 Aug 02 09:47:38.844321 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1718/4068] 10.222.0.100 () {60 vars in 1267 bytes} [Tue Aug 2 09:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998615020 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:47:39.393525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b79bf548-710c-4aa9-8410-a4cec85b0022 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c180e15e0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:39.425878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b79bf548-710c-4aa9-8410-a4cec85b0022 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 287 microversion: 2.1 time: 0.036120 Aug 02 09:47:39.426461 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2351/4069] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:39 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:40.439526 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-23fbb3aa-2477-4610-aed3-676b2f845c31 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1c0ac0d0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:40.468459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-23fbb3aa-2477-4610-aed3-676b2f845c31 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 287 microversion: 2.1 time: 0.033155 Aug 02 09:47:40.469014 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1719/4070] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:40 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:47:41.480873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-78213896-2a81-4ce1-96aa-761704742792 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c137fbdc0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:41.511674 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-78213896-2a81-4ce1-96aa-761704742792 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 287 microversion: 2.1 time: 0.035160 Aug 02 09:47:41.513371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2352/4071] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:41 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:42.525991 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-08e8c309-d28d-497c-a742-d49450516278 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1c0ace50>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:42.556055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-08e8c309-d28d-497c-a742-d49450516278 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 288 microversion: 2.1 time: 0.034560 Aug 02 09:47:42.556620 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1720/4072] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:42 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:42.568196 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ce138f47-246c-4959-8b3b-b2838c301e0e tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c137fc1f0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:42.626484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ce138f47-246c-4959-8b3b-b2838c301e0e tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "DELETE /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 202 len: 0 microversion: 2.1 time: 0.062589 Aug 02 09:47:42.627068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2353/4073] 10.222.0.100 () {58 vars in 1259 bytes} [Tue Aug 2 09:47:42 2022] DELETE /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:47:42.635562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6fbadbd4-a92f-4999-ba8c-f531323e61ba tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1c0ac280>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:42.666061 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6fbadbd4-a92f-4999-ba8c-f531323e61ba tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 200 len: 287 microversion: 2.1 time: 0.034275 Aug 02 09:47:42.666631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1721/4074] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:42 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:42.704720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:42.705281 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:42.711434 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:42.711882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:42.712644 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:42.713080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:42.727176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] HTTP exception thrown: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Request method failure captured: Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 HTTP/1.1 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oouc7JQ4CTMM00_Rfdj1e1P6EJk55bwSCzJ2jO0VH01BeeOSCeJ0MH3wnE81X6tOpRR569C0JNfq7Imgb1gQ3X0ToSoV4XtJBFvojbzLJlNGizTi0Ul9KjCR38bfn8jmAnZN3BBMh04MT4RsxT-Yqgu8qk8CxbMedUcDUvmwfwRtS8 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:42.728725 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 0e93d159e8644203808918c5ae86fc74 Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.730755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'd6c0537f-91ad-4f13-ad40-d178194a1d43'} Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:42.731795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.733657 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.735493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Returning 404 to user: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:42.735493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8f7d19e9-2923-477e-9bf4-6e46e787912a tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 404 len: 111 microversion: 2.20 time: 0.029576 Aug 02 09:47:42.735493 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2354/4075] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:47:42 2022] DELETE /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:47:42.739051 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:42.739829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: d6c0537f-91ad-4f13-ad40-d178194a1d43] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:42.746582 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:42.747070 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:42.747961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:42.748406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:42.764647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] HTTP exception thrown: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Request method failure captured: Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 HTTP/1.1 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Oouc7JQ4CTMM00_Rfdj1e1P6EJk55bwSCzJ2jO0VH01BeeOSCeJ0MH3wnE81X6tOpRR569C0JNfq7Imgb1gQ3X0ToSoV4XtJBFvojbzLJlNGizTi0Ul9KjCR38bfn8jmAnZN3BBMh04MT4RsxT-Yqgu8qk8CxbMedUcDUvmwfwRtS8 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:42.766344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 0e93d159e8644203808918c5ae86fc74 Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.769306 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'd6c0537f-91ad-4f13-ad40-d178194a1d43'} Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:42.770781 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. Aug 02 09:47:42.773651 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:42.776315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Returning 404 to user: Instance d6c0537f-91ad-4f13-ad40-d178194a1d43 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:42.776315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-27d193d5-6121-4fcf-8832-44a992be82ca tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43" status: 404 len: 111 microversion: 2.20 time: 0.032665 Aug 02 09:47:42.776315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1722/4076] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:47:42 2022] GET /compute/v2.1/servers/d6c0537f-91ad-4f13-ad40-d178194a1d43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:47:43.678848 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa389bef-1b0a-4510-bbad-69b3932ec25c tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c18089040>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:43.705649 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-fa389bef-1b0a-4510-bbad-69b3932ec25c tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] HTTP exception thrown: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa389bef-1b0a-4510-bbad-69b3932ec25c tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Request method failure captured: Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 HTTP/1.1 Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6PK4rfC9RL1Hn3DIqlCAR5wXybzr32LMqBAGJvVIjctNQq3MG0OrETbSEJy1vQwrw1SRQdgg6jxKKvYtZ7o-Vo6fTQfZBiehYalUJODIpmms_XiYQL--QIQKR_MiIFcg5K2PINVMNA6xMk9OuxdjVnlZzC491-fwvwWt-uV33wVuJzQ Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:43.708209 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 715b6c0ca114451dba6aa6c59b6b3ee7 Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'd9cfd6a0-eadf-48f5-83ba-79788b97cae7'} Aug 02 09:47:43.710000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. (HTTP 404) (Request-ID: req-321781e5-8878-49db-a8b8-6cba5f5fd61d) Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.711312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:47:43.712972 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 09:47:43.714820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fa389bef-1b0a-4510-bbad-69b3932ec25c tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Returning 404 to user: Snapshot d9cfd6a0-eadf-48f5-83ba-79788b97cae7 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:43.716668 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fa389bef-1b0a-4510-bbad-69b3932ec25c tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7" status: 404 len: 111 microversion: 2.1 time: 0.034965 Aug 02 09:47:43.717873 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2355/4077] 10.222.0.100 () {58 vars in 1256 bytes} [Tue Aug 2 09:47:43 2022] GET /compute/v2.1/os-snapshots/d9cfd6a0-eadf-48f5-83ba-79788b97cae7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:43.720740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-8de763ee-fb34-4032-a8a0-ec6699acc075 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1820d9d0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:43.787783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-8de763ee-fb34-4032-a8a0-ec6699acc075 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 202 len: 0 microversion: 2.1 time: 0.070922 Aug 02 09:47:43.788420 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1723/4078] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:47:43 2022] DELETE /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:47:43.798414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-76efe04c-d2e3-4e58-80f9-e98c63acced8 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c180893a0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:43.848997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-76efe04c-d2e3-4e58-80f9-e98c63acced8 tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 200 len: 345 microversion: 2.1 time: 0.056049 Aug 02 09:47:43.849772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2356/4079] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:47:43 2022] GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:47:43.920071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:43.921052 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:43.928792 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:43.929330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:43.930147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:43.930574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:43.946263 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] HTTP exception thrown: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Request method failure captured: Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d HTTP/1.1 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6Oouc7JQ4CTMM00_Rfdj1e1P6EJk55bwSCzJ2jO0VH01BeeOSCeJ0MH3wnE81X6tOpRR569C0JNfq7Imgb1gQ3X0ToSoV4XtJBFvojbzLJlNGizTi0Ul9KjCR38bfn8jmAnZN3BBMh04MT4RsxT-Yqgu8qk8CxbMedUcDUvmwfwRtS8 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:43.947862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 0e93d159e8644203808918c5ae86fc74 Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.949910 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'c376609c-79b9-4ca5-91a3-febc97aecc9d'} Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:43.951113 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.952913 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.954772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Returning 404 to user: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:43.954772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bedf43f8-601f-4143-883c-42dfaa23bee6 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 404 len: 111 microversion: 2.20 time: 0.034778 Aug 02 09:47:43.954772 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1724/4080] 10.222.0.100 () {60 vars in 1285 bytes} [Tue Aug 2 09:47:43 2022] DELETE /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:47:43.958389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:43.959008 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] [instance: c376609c-79b9-4ca5-91a3-febc97aecc9d] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:47:43.965371 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:43.965829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:43.966662 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:47:43.967101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:47:43.987844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] HTTP exception thrown: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Request method failure captured: Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d HTTP/1.1 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6Oouc7JQ4CTMM00_Rfdj1e1P6EJk55bwSCzJ2jO0VH01BeeOSCeJ0MH3wnE81X6tOpRR569C0JNfq7Imgb1gQ3X0ToSoV4XtJBFvojbzLJlNGizTi0Ul9KjCR38bfn8jmAnZN3BBMh04MT4RsxT-Yqgu8qk8CxbMedUcDUvmwfwRtS8 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:43.990871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/ada46409d8ae4abfaf19056675f7fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: ada46409d8ae4abfaf19056675f7fbc6 Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1003647537 Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 0e93d159e8644203808918c5ae86fc74 Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1003647537-project Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.992584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'c376609c-79b9-4ca5-91a3-febc97aecc9d'} Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:43.993527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. Aug 02 09:47:43.994995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:43.997073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] Returning 404 to user: Instance c376609c-79b9-4ca5-91a3-febc97aecc9d could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:43.997073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2088353d-3154-46fb-8561-0f1444180cd3 tempest-AttachVolumeShelveTestJSON-1003647537 tempest-AttachVolumeShelveTestJSON-1003647537-project] 10.222.0.100 "GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d" status: 404 len: 111 microversion: 2.20 time: 0.039526 Aug 02 09:47:43.997073 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2357/4081] 10.222.0.100 () {60 vars in 1282 bytes} [Tue Aug 2 09:47:43 2022] GET /compute/v2.1/servers/c376609c-79b9-4ca5-91a3-febc97aecc9d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:47:44.863437 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da2ea173-7fd9-463f-a7bc-ab8c73ff938b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1c0acca0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:44.893658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-da2ea173-7fd9-463f-a7bc-ab8c73ff938b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] HTTP exception thrown: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da2ea173-7fd9-463f-a7bc-ab8c73ff938b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Request method failure captured: Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a HTTP/1.1 Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6PK4rfC9RL1Hn3DIqlCAR5wXybzr32LMqBAGJvVIjctNQq3MG0OrETbSEJy1vQwrw1SRQdgg6jxKKvYtZ7o-Vo6fTQfZBiehYalUJODIpmms_XiYQL--QIQKR_MiIFcg5K2PINVMNA6xMk9OuxdjVnlZzC491-fwvwWt-uV33wVuJzQ Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:44.895687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 715b6c0ca114451dba6aa6c59b6b3ee7 Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'b5c67b57-f583-4c71-b9cf-d71af502b35a'} Aug 02 09:47:44.897329 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. (HTTP 404) (Request-ID: req-7b3aaefe-6bdc-407b-b995-49b6d1466d7d) Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.898578 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:47:44.899957 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:47:44.901314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da2ea173-7fd9-463f-a7bc-ab8c73ff938b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Returning 404 to user: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-da2ea173-7fd9-463f-a7bc-ab8c73ff938b tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 404 len: 109 microversion: 2.1 time: 0.037686 Aug 02 09:47:44.903815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1725/4082] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:47:44 2022] GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:44.913133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69bdf617-1d6d-42b5-9189-d81abb870cbe tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c137fc5e0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:44.945758 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-69bdf617-1d6d-42b5-9189-d81abb870cbe tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] HTTP exception thrown: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69bdf617-1d6d-42b5-9189-d81abb870cbe tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Request method failure captured: Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a HTTP/1.1 Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6PK4rfC9RL1Hn3DIqlCAR5wXybzr32LMqBAGJvVIjctNQq3MG0OrETbSEJy1vQwrw1SRQdgg6jxKKvYtZ7o-Vo6fTQfZBiehYalUJODIpmms_XiYQL--QIQKR_MiIFcg5K2PINVMNA6xMk9OuxdjVnlZzC491-fwvwWt-uV33wVuJzQ Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:47:44.947696 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 715b6c0ca114451dba6aa6c59b6b3ee7 Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': 'b5c67b57-f583-4c71-b9cf-d71af502b35a'} Aug 02 09:47:44.950071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. (HTTP 404) (Request-ID: req-a679aaf9-a20d-4750-98b1-ae33c49fd582) Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.951124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:47:44.952573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:47:44.954006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-69bdf617-1d6d-42b5-9189-d81abb870cbe tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Returning 404 to user: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:44.955559 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-69bdf617-1d6d-42b5-9189-d81abb870cbe tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 404 len: 109 microversion: 2.1 time: 0.039851 Aug 02 09:47:44.956626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2358/4083] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:47:44 2022] DELETE /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:47:44.959721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da1838ce-58c4-44b1-83e6-0ac1ffda8d0a tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Calling method '.version_select at 0x7f8c1c0ac550>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:47:44.987977 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-da1838ce-58c4-44b1-83e6-0ac1ffda8d0a tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] HTTP exception thrown: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da1838ce-58c4-44b1-83e6-0ac1ffda8d0a tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Request method failure captured: Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a HTTP/1.1 Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6PK4rfC9RL1Hn3DIqlCAR5wXybzr32LMqBAGJvVIjctNQq3MG0OrETbSEJy1vQwrw1SRQdgg6jxKKvYtZ7o-Vo6fTQfZBiehYalUJODIpmms_XiYQL--QIQKR_MiIFcg5K2PINVMNA6xMk9OuxdjVnlZzC491-fwvwWt-uV33wVuJzQ Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:47:44.989970 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0baa696bf0e14062b974d2eac6edb520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 0baa696bf0e14062b974d2eac6edb520 Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1464499947 Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 715b6c0ca114451dba6aa6c59b6b3ee7 Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1464499947-project Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'b5c67b57-f583-4c71-b9cf-d71af502b35a'} Aug 02 09:47:44.991809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. (HTTP 404) (Request-ID: req-c1d5b306-fe8e-4650-b7b1-ae651873f921) Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.992750 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:47:44.994155 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:47:44.996381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-da1838ce-58c4-44b1-83e6-0ac1ffda8d0a tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] Returning 404 to user: Volume b5c67b57-f583-4c71-b9cf-d71af502b35a could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-da1838ce-58c4-44b1-83e6-0ac1ffda8d0a tempest-VolumesSnapshotsTestJSON-1464499947 tempest-VolumesSnapshotsTestJSON-1464499947-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a" status: 404 len: 109 microversion: 2.1 time: 0.036474 Aug 02 09:47:44.998807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1726/4084] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:47:44 2022] GET /compute/v2.1/os-volumes/b5c67b57-f583-4c71-b9cf-d71af502b35a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:48:34.280507 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:34.281306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:34.285283 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1616299915", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "networks": [{"uuid": "b9005eca-1a88-4f87-b5e3-5299e293b68f"}]}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:48:34.511866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] validate_networks() for [('b9005eca-1a88-4f87-b5e3-5299e293b68f', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:48:34.874325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:48:34.874749 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:48:34.875225 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:48:34.875654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:48:34.876067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:48:34.886151 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:34.886591 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:34.887385 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:34.887821 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:34.905372 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Getting quotas for project 90a51464bbe04f8eb92cf3fe58374256. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:48:34.909451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Getting quotas for user 96b0af2a0a8440a98e8092594f090bea and project 90a51464bbe04f8eb92cf3fe58374256. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:48:34.921161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:48:34.923446 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:48:34.972068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-10b24e11-4de0-416d-8b07-b82e680aee2a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.694100 Aug 02 09:48:34.972718 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2359/4085] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:48:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:48:34.981812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:34.982565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:34.986747 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-3ad50ede-bc9f-4b43-a4a3-a2b8a05a41cf tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:34.987359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-3ad50ede-bc9f-4b43-a4a3-a2b8a05a41cf tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:35.139637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-3ad50ede-bc9f-4b43-a4a3-a2b8a05a41cf tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:35.147331 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-3ad50ede-bc9f-4b43-a4a3-a2b8a05a41cf tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1218 microversion: 2.1 time: 0.167063 Aug 02 09:48:35.147945 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1727/4086] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:34 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:36.174818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:36.175460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:36.182417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:36.182866 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:36.183862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:36.184634 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:36.266510 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:36.283869 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-30e02579-2456-446b-a537-13e968883c2b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1278 microversion: 2.1 time: 0.115793 Aug 02 09:48:36.285268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2360/4087] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:36 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:37.307935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:37.308696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:37.315208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:37.315658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:37.316424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:37.316865 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:37.455636 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:37.464667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4deb45db-8602-46b3-b118-1ed5899ab960 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.161168 Aug 02 09:48:37.465581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1728/4088] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:37 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:37.502737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-26398fcb-2bca-4fd2-943f-ffdef3334d5a req-14a07692-d94d-4a4e-b81f-b265e0e8a835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6c5d09-2632-436b-b5a6-a289e21c9749", "tag": "24af94de-1ae4-4b92-8967-b5348fb605fb"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:48:37.517299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-26398fcb-2bca-4fd2-943f-ffdef3334d5a req-14a07692-d94d-4a4e-b81f-b265e0e8a835 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:37.518202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-26398fcb-2bca-4fd2-943f-ffdef3334d5a req-14a07692-d94d-4a4e-b81f-b265e0e8a835 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:37.533565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-26398fcb-2bca-4fd2-943f-ffdef3334d5a req-14a07692-d94d-4a4e-b81f-b265e0e8a835 service nova] Creating event network-changed:24af94de-1ae4-4b92-8967-b5348fb605fb for instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 on hv-cinder-80382 Aug 02 09:48:37.539760 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-26398fcb-2bca-4fd2-943f-ffdef3334d5a req-14a07692-d94d-4a4e-b81f-b265e0e8a835 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041773 Aug 02 09:48:37.540441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2361/4089] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:48:38.487104 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:38.487686 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:38.494608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:38.495063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:38.495828 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:38.496271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:38.623851 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:38.631463 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c8971dc8-ef23-4b76-b0f4-8ff1de973084 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.148446 Aug 02 09:48:38.632038 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1729/4090] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:38 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:39.655298 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:39.656050 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:39.662331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:39.662782 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:39.663544 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:39.663977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:39.807814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:39.815807 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-65a6793d-0969-4bc0-a551-b5ec5ee76819 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.166213 Aug 02 09:48:39.816382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2362/4091] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:39 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:40.839386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:40.839995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:40.846471 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:40.846918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:40.847681 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:40.848124 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:40.980440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:40.987889 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a6123fcd-5cdd-4121-8865-83430fda0e5b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.153481 Aug 02 09:48:40.989266 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1730/4092] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:40 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:42.013902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:42.014616 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:42.022741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:42.023191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:42.024243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:42.024808 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:42.169991 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:42.178261 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8925dddf-69e5-4b8e-b6c7-06f3857113e9 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.169210 Aug 02 09:48:42.178861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2363/4093] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:42 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:43.211567 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:43.212760 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:43.219159 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:43.219608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:43.220365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:43.220797 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:43.351691 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:43.359428 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4364965b-4a49-4332-a685-3dc172513c26 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.151746 Aug 02 09:48:43.359995 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1731/4094] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:43 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:44.382325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:44.382979 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:44.389931 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:44.390383 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:44.391251 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:44.391688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:44.520957 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:44.530123 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4e498256-fb11-41a3-807a-7645a319e88c tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.151869 Aug 02 09:48:44.530714 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2364/4095] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:44 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:45.551845 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:45.552461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:45.554856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:45.561047 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:45.561565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:45.562387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:45.562829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:45.695282 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:45.702727 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cc9017ea-946e-4fdb-b692-c2092745b2df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.154813 Aug 02 09:48:45.703295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1732/4096] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:45 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:46.706491 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-de664f65-3b85-4b02-b7cf-c72074a6e594 req-69a7521d-4a48-4418-93bb-0659de6fe4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6c5d09-2632-436b-b5a6-a289e21c9749", "name": "network-vif-plugged", "status": "completed", "tag": "24af94de-1ae4-4b92-8967-b5348fb605fb"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:48:46.711466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:46.712891 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:48:46.721568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-de664f65-3b85-4b02-b7cf-c72074a6e594 req-69a7521d-4a48-4418-93bb-0659de6fe4ff service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:46.722278 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-de664f65-3b85-4b02-b7cf-c72074a6e594 req-69a7521d-4a48-4418-93bb-0659de6fe4ff service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:46.723432 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:46.724675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:46.731938 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:46.732616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:46.733583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:46.734318 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:46.735044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-de664f65-3b85-4b02-b7cf-c72074a6e594 req-69a7521d-4a48-4418-93bb-0659de6fe4ff service nova] Creating event network-vif-plugged:24af94de-1ae4-4b92-8967-b5348fb605fb for instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 on hv-cinder-80382 Aug 02 09:48:46.740287 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-de664f65-3b85-4b02-b7cf-c72074a6e594 req-69a7521d-4a48-4418-93bb-0659de6fe4ff service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037585 Aug 02 09:48:46.741062 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2365/4097] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:48:46.899880 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:46.908343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-767a6405-273f-400e-a336-8c08f111983a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.188650 Aug 02 09:48:46.909016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1733/4098] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:46 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:47.931629 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:47.932451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:47.938654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:47.939095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:47.939842 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:47.940272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:48.076484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:48.083883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-54c3f50a-5324-43e2-ab9d-2c1eaf469c29 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1318 microversion: 2.1 time: 0.157811 Aug 02 09:48:48.084453 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2366/4099] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:47 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:49.106277 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:49.106933 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:49.113456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:49.113923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:49.114679 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:49.115110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:49.252920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:49.261055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-afdd111b-a1a5-4e04-a124-79fdf437221f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1502 microversion: 2.1 time: 0.159587 Aug 02 09:48:49.261654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1734/4100] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:49 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:49.768169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:49.768732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:49.776100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:49.776726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:49.777529 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:49.778066 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:49.806961 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:48:49.886971 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-dbe1070b-b61a-4b3c-9d0b-6c9214deb13d tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 204 len: 0 microversion: 2.1 time: 0.122730 Aug 02 09:48:49.887588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2367/4101] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:48:49 2022] DELETE /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:48:49.896534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:49.897176 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:49.904510 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:49.904961 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:49.905955 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:49.906398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:50.040096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:50.047794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0dd937de-84a4-4b38-81c6-6c5ba908892b tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1508 microversion: 2.1 time: 0.155147 Aug 02 09:48:50.048366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1735/4102] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:49 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:51.070999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:51.072460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:51.078926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:51.079374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:51.080127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:51.080558 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:51.214307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:51.221874 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e6abfd4c-dee9-44b8-b903-a0ed5d27960a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1508 microversion: 2.1 time: 0.155250 Aug 02 09:48:51.222450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2368/4103] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:51 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:51.923209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-271fe595-d436-4f9d-a8ca-87df3697f676 req-2e22e8f6-fdd8-484d-a1ec-2c5afbd12dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6c5d09-2632-436b-b5a6-a289e21c9749", "name": "network-vif-deleted", "tag": "24af94de-1ae4-4b92-8967-b5348fb605fb"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:48:51.934360 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-271fe595-d436-4f9d-a8ca-87df3697f676 req-2e22e8f6-fdd8-484d-a1ec-2c5afbd12dea service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:51.934800 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-271fe595-d436-4f9d-a8ca-87df3697f676 req-2e22e8f6-fdd8-484d-a1ec-2c5afbd12dea service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:51.947673 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-271fe595-d436-4f9d-a8ca-87df3697f676 req-2e22e8f6-fdd8-484d-a1ec-2c5afbd12dea service nova] Creating event network-vif-deleted:24af94de-1ae4-4b92-8967-b5348fb605fb for instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 on hv-cinder-80382 Aug 02 09:48:51.952765 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-271fe595-d436-4f9d-a8ca-87df3697f676 req-2e22e8f6-fdd8-484d-a1ec-2c5afbd12dea service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Aug 02 09:48:51.953515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1736/4104] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:48:52.244844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:52.245475 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:52.252096 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:52.252547 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:52.253348 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:52.253788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:52.287654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:52.288102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:52.288561 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lazy-loading 'fault' on Instance uuid 2a6c5d09-2632-436b-b5a6-a289e21c9749 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:48:52.331677 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:52.341026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9599158d-410d-4598-a6c8-95d56312fe75 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 200 len: 1308 microversion: 2.1 time: 0.100780 Aug 02 09:48:52.341645 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2369/4105] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:52 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:53.364180 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:53.364874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: 2a6c5d09-2632-436b-b5a6-a289e21c9749] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:53.371874 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:53.372302 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:53.373057 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:53.373512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:53.387195 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] HTTP exception thrown: Instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 could not be found. Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Request method failure captured: Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 HTTP/1.1 Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6PLwbyt9ViGykaSNrwRSAh7yJyA0Ueka3QbZaw2xXVAXrVuhqikXaPx0iOCNuVdOlsx47sI47hkI9ZglXT6vpNyKviXFpCfpg3sMm5yXy2JO4rBOoHTQIvuGjpqj1bQkWf-OLhHHAakZO4awnLfcNOnd_v1NFczbDhF-wh5acH7OSck Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 90a51464bbe04f8eb92cf3fe58374256 Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesActionsTest-2030335215 Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:48:53.388806 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesActionsTest-2030335215 Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 90a51464bbe04f8eb92cf3fe58374256 Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesActionsTest-2030335215 Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesActionsTest-2030335215-project Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 96b0af2a0a8440a98e8092594f090bea Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesActionsTest-2030335215-project Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 could not be found. Aug 02 09:48:53.390825 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '2a6c5d09-2632-436b-b5a6-a289e21c9749'} Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 could not be found. Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:48:53.416774 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 could not be found. Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 could not be found. Aug 02 09:48:53.419775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:48:53.421083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Returning 404 to user: Instance 2a6c5d09-2632-436b-b5a6-a289e21c9749 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:48:53.421083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-020e339f-a9e5-4acb-902a-f1cd46c3162a tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749" status: 404 len: 111 microversion: 2.1 time: 0.030710 Aug 02 09:48:53.421083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1737/4106] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:53 2022] GET /compute/v2.1/servers/2a6c5d09-2632-436b-b5a6-a289e21c9749 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:48:53.450324 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1870572411", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "networks": [{"uuid": "b9005eca-1a88-4f87-b5e3-5299e293b68f"}]}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:48:53.502902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.network.neutron [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] validate_networks() for [('b9005eca-1a88-4f87-b5e3-5299e293b68f', None, None, None, None, None)] {{(pid=117908) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:48:53.872108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Flavor limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:48:53.872548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Image limits 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:48:53.873043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Flavor pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:48:53.873471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Image pref 0:0:0 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:48:53.873875 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.virt.hardware [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:48:53.882959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:53.883424 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:53.884409 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:53.884838 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:53.902299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Getting quotas for project 90a51464bbe04f8eb92cf3fe58374256. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:48:53.906494 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Getting quotas for user 96b0af2a0a8440a98e8092594f090bea and project 90a51464bbe04f8eb92cf3fe58374256. Resources: {'cores', 'instances', 'ram'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:48:53.918565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Going to run 1 instances... {{(pid=117908) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:48:53.920827 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:48:53.965047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0995eded-261d-4980-bf71-4671b5541b84 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.519091 Aug 02 09:48:53.965735 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2370/4107] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:48:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:48:53.976545 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9ba04812-1d29-483e-94d6-514044882aca tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:53.977791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9ba04812-1d29-483e-94d6-514044882aca tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:54.037520 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9ba04812-1d29-483e-94d6-514044882aca tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:54.045671 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9ba04812-1d29-483e-94d6-514044882aca tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1218 microversion: 2.1 time: 0.072977 Aug 02 09:48:54.046330 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1738/4108] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:53 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:55.068022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:55.069315 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:55.079889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:55.080402 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:55.083818 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:55.084743 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:55.162279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:55.170601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e3271e0-318d-4809-922c-d765fcd56778 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1288 microversion: 2.1 time: 0.108459 Aug 02 09:48:55.171183 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2371/4109] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:55 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:56.195081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:56.195647 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:56.204315 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:56.204775 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:56.205584 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:56.206029 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:56.338323 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:56.359214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-14b2db36-11e5-4a66-a178-010c86fe9b4f tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1318 microversion: 2.1 time: 0.170022 Aug 02 09:48:56.359814 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1739/4110] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:56 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:56.621726 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-336f078d-6de4-41f1-aac0-98d8446ca711 req-d803e79d-b87f-4476-ad5e-e34338b0b3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb9133c-8848-4a76-bf66-bff7da9ae4fa", "tag": "f38f98d9-7885-46c7-ad96-d67a99814b9d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:48:56.632181 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-336f078d-6de4-41f1-aac0-98d8446ca711 req-d803e79d-b87f-4476-ad5e-e34338b0b3c1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:56.632626 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-336f078d-6de4-41f1-aac0-98d8446ca711 req-d803e79d-b87f-4476-ad5e-e34338b0b3c1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:56.645071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-336f078d-6de4-41f1-aac0-98d8446ca711 req-d803e79d-b87f-4476-ad5e-e34338b0b3c1 service nova] Creating event network-changed:f38f98d9-7885-46c7-ad96-d67a99814b9d for instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa on hv-cinder-80382 Aug 02 09:48:56.650215 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-336f078d-6de4-41f1-aac0-98d8446ca711 req-d803e79d-b87f-4476-ad5e-e34338b0b3c1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033102 Aug 02 09:48:56.651068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2372/4111] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:48:57.381631 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:57.382178 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:57.389364 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:57.389819 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:57.390589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:57.391033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:57.522472 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:57.530314 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-20d102d0-5a13-43c0-909e-3340c54484df tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1318 microversion: 2.1 time: 0.153118 Aug 02 09:48:57.530884 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1740/4112] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:57 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:58.552930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:58.553679 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:58.560093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:58.560572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:58.561366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:58.561805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:58.694820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:58.702435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-7aebc8cb-623e-4052-90c4-a3717ca5fb62 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1318 microversion: 2.1 time: 0.154236 Aug 02 09:48:58.703022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2373/4113] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:58 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:48:59.723553 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:48:59.724193 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:48:59.731511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:59.731960 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:59.732721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:48:59.733179 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:48:59.860611 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:48:59.869175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fb1477f6-4546-4df6-bf22-a58a97488535 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1318 microversion: 2.1 time: 0.149461 Aug 02 09:48:59.869746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1741/4114] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:48:59 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:00.830037 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-07aff00e-b66c-49cd-b675-6534700619fb req-8b31dbd5-258d-459d-9189-1e90f9df646c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb9133c-8848-4a76-bf66-bff7da9ae4fa", "name": "network-vif-plugged", "status": "completed", "tag": "f38f98d9-7885-46c7-ad96-d67a99814b9d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:49:00.841038 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-07aff00e-b66c-49cd-b675-6534700619fb req-8b31dbd5-258d-459d-9189-1e90f9df646c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:00.841519 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-07aff00e-b66c-49cd-b675-6534700619fb req-8b31dbd5-258d-459d-9189-1e90f9df646c service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:00.854937 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-07aff00e-b66c-49cd-b675-6534700619fb req-8b31dbd5-258d-459d-9189-1e90f9df646c service nova] Creating event network-vif-plugged:f38f98d9-7885-46c7-ad96-d67a99814b9d for instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa on hv-cinder-80382 Aug 02 09:49:00.859711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-07aff00e-b66c-49cd-b675-6534700619fb req-8b31dbd5-258d-459d-9189-1e90f9df646c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Aug 02 09:49:00.860318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2374/4115] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:49:00.890791 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:00.891399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:00.898230 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:00.898762 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:00.899710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:00.900152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:01.039374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:49:01.047035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ddce8294-e483-47e9-8462-452d8fc2ffae tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1318 microversion: 2.1 time: 0.160293 Aug 02 09:49:01.047606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1742/4116] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:00 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:02.069584 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:02.070358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:02.076772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:02.077265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:02.078045 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:02.078485 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:02.212893 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:49:02.220389 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-090abd0e-1870-483e-b44b-297aa1af2538 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1318 microversion: 2.1 time: 0.155593 Aug 02 09:49:02.220967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2375/4117] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:02 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:03.241305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:03.241877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:03.249399 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:03.249863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:03.250685 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:03.251128 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:03.389807 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:49:03.397564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9684a588-91d7-4d9d-bc0c-b060659f9a87 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1503 microversion: 2.1 time: 0.160148 Aug 02 09:49:03.398365 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1743/4118] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:03 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:03.914653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:03.915252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:03.918588 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:03.919418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:03.926263 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:03.926720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:03.927497 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:03.927940 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:03.954341 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:49:03.986259 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:04.041492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-04bc9073-7d0d-42c4-aeb3-4a5b46e8b3b4 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 204 len: 0 microversion: 2.1 time: 0.130542 Aug 02 09:49:04.045161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2376/4119] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:49:03 2022] DELETE /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:49:04.053189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:04.054116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:04.056320 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:04.064570 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:04.065234 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:04.066025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:04.066680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:04.196341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:49:04.204612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-aaafcfcc-306d-45d9-891b-55b7f764a241 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1509 microversion: 2.1 time: 0.156599 Aug 02 09:49:04.205237 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1744/4120] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:04 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:05.226044 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:05.226738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:05.229079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:05.234795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:05.235237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:05.235990 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:05.236419 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:05.374276 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:49:05.382321 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e56af1cb-2432-488c-adbc-416fd78635a6 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1509 microversion: 2.1 time: 0.160494 Aug 02 09:49:05.382897 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2377/4121] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:05 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:06.075424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-24d75c98-793e-486f-ab0e-74dd8d4bd919 req-162901f3-07cc-42e4-a39a-38ed26d185ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb9133c-8848-4a76-bf66-bff7da9ae4fa", "name": "network-vif-deleted", "tag": "f38f98d9-7885-46c7-ad96-d67a99814b9d"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:49:06.080863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=41 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:06.086759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-24d75c98-793e-486f-ab0e-74dd8d4bd919 req-162901f3-07cc-42e4-a39a-38ed26d185ef service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:06.087354 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-24d75c98-793e-486f-ab0e-74dd8d4bd919 req-162901f3-07cc-42e4-a39a-38ed26d185ef service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:06.091066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=89 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:49:06.100844 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-24d75c98-793e-486f-ab0e-74dd8d4bd919 req-162901f3-07cc-42e4-a39a-38ed26d185ef service nova] Creating event network-vif-deleted:f38f98d9-7885-46c7-ad96-d67a99814b9d for instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa on hv-cinder-80382 Aug 02 09:49:06.106373 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-24d75c98-793e-486f-ab0e-74dd8d4bd919 req-162901f3-07cc-42e4-a39a-38ed26d185ef service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Aug 02 09:49:06.107247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1745/4122] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:49:06.404083 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:06.404741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:06.411161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:06.411612 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:06.412386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:06.412831 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:06.445340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:06.445788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:06.446243 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lazy-loading 'fault' on Instance uuid ecb9133c-8848-4a76-bf66-bff7da9ae4fa {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:49:06.502641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b0af2a0a8440a98e8092594f090bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a51464bbe04f8eb92cf3fe58374256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:49:06.512266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-49bfef4c-29c5-4ee7-9ed6-3e1b5e812d52 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 200 len: 1308 microversion: 2.1 time: 0.111567 Aug 02 09:49:06.513223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2378/4123] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:06 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:49:07.534059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:49:07.534779 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] [instance: ecb9133c-8848-4a76-bf66-bff7da9ae4fa] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:49:07.541071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:07.541544 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:07.542311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:49:07.542887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:49:07.556487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] HTTP exception thrown: Instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa could not be found. Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Request method failure captured: Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa HTTP/1.1 Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6PLwbyt9ViGykaSNrwRSAh7yJyA0Ueka3QbZaw2xXVAXrVuhqikXaPx0iOCNuVdOlsx47sI47hkI9ZglXT6vpNyKviXFpCfpg3sMm5yXy2JO4rBOoHTQIvuGjpqj1bQkWf-OLhHHAakZO4awnLfcNOnd_v1NFczbDhF-wh5acH7OSck Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 90a51464bbe04f8eb92cf3fe58374256 Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-VolumesActionsTest-2030335215 Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:49:07.558721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/90a51464bbe04f8eb92cf3fe58374256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-VolumesActionsTest-2030335215 Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 90a51464bbe04f8eb92cf3fe58374256 Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-VolumesActionsTest-2030335215 Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-VolumesActionsTest-2030335215-project Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 96b0af2a0a8440a98e8092594f090bea Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-VolumesActionsTest-2030335215-project Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa could not be found. Aug 02 09:49:07.559858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': 'ecb9133c-8848-4a76-bf66-bff7da9ae4fa'} Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa could not be found. Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:49:07.560456 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa could not be found. Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa could not be found. Aug 02 09:49:07.561506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:49:07.562530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] Returning 404 to user: Instance ecb9133c-8848-4a76-bf66-bff7da9ae4fa could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:49:07.562530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-050a26cc-0e85-4d7f-b696-e8c433414bd8 tempest-VolumesActionsTest-2030335215 tempest-VolumesActionsTest-2030335215-project] 10.222.0.100 "GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa" status: 404 len: 111 microversion: 2.1 time: 0.030947 Aug 02 09:49:07.562530 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1746/4124] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:49:07 2022] GET /compute/v2.1/servers/ecb9133c-8848-4a76-bf66-bff7da9ae4fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:49:39.668667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:49:39.669317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:49:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:51:11.886876 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:51:11.887422 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:51:29.688362 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:51:29.689272 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:51:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:51:40.327690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:51:40.328262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:51:52.072296 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [081849dc-17b7-41b7-af3a-3a3efad5788a] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 09:51:52.073222 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=5 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:51:52.074506 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:51:52.078704 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:52.079190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:52.088948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.090253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.091332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.092135 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.132407 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:51:52.240852 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-607b49cd-3ff3-449c-b737-0460b410a8f0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 204 len: 0 microversion: 2.1 time: 0.170137 Aug 02 09:51:52.242824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2379/4125] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:51:52 2022] DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:51:52.258653 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:52.259396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:52.264002 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f7d9d634-741a-4c5a-9ad9-d6cf5eaab494] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 09:51:52.264513 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:51:52.265201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:51:52.271424 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.272016 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.272829 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.273352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.429911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:52.443813 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e5dc0b94-edfc-4c4e-a7c4-06992e2982d5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1722 microversion: 2.1 time: 0.193498 Aug 02 09:51:52.444888 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1747/4126] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:52 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:52.814221 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:52.814820 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:52.821253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.821710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.822484 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.822929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.851715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:51:52.946573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9ccdb133-b9cb-4e2b-b3e5-bbb62599cc6f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "DELETE /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 204 len: 0 microversion: 2.1 time: 0.136104 Aug 02 09:51:52.947628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2380/4127] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:51:52 2022] DELETE /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:51:52.958744 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:52.959509 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:52.968305 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.968835 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:52.969848 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:52.970580 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:53.134450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:53.146802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e43dc295-7294-4339-8561-65f58b2617b7 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1511 microversion: 2.1 time: 0.192958 Aug 02 09:51:53.147761 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1748/4128] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:52 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:53.475121 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:53.475853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:53.489270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:53.490074 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:53.491122 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:53.491590 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:53.500043 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] [081849dc-17b7-41b7-af3a-3a3efad5788a] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 57420. Aug 02 09:51:53.779457 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:53.793913 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-4b3b58f6-9cca-4a4b-a493-4f116e4c0bb6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1722 microversion: 2.1 time: 0.322233 Aug 02 09:51:53.794872 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2381/4129] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:53 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:51:54.180105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:54.181366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:54.194759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:54.195562 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:54.196583 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:54.197206 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:54.221911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] [f7d9d634-741a-4c5a-9ad9-d6cf5eaab494] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 57424. Aug 02 09:51:54.460899 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:54.472532 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-287e53b3-4f68-49dc-9434-50a3b61c904c tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1511 microversion: 2.1 time: 0.298199 Aug 02 09:51:54.488050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1749/4130] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:54 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:54.748814 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-bd0c0579-5d7d-4a28-bf38-5cb5c917f00a req-011f2c95-cd22-4086-99c3-2ee2824221e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50686e38-723f-480e-9e37-f2d5e9eaaaf0", "name": "network-vif-deleted", "tag": "a3c7682a-1f13-4534-9677-cb0f7ec6315f"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:51:54.772783 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-bd0c0579-5d7d-4a28-bf38-5cb5c917f00a req-011f2c95-cd22-4086-99c3-2ee2824221e0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:54.773777 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-bd0c0579-5d7d-4a28-bf38-5cb5c917f00a req-011f2c95-cd22-4086-99c3-2ee2824221e0 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:54.799513 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-bd0c0579-5d7d-4a28-bf38-5cb5c917f00a req-011f2c95-cd22-4086-99c3-2ee2824221e0 service nova] Creating event network-vif-deleted:a3c7682a-1f13-4534-9677-cb0f7ec6315f for instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 on hv-cinder-80382 Aug 02 09:51:54.820846 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-bd0c0579-5d7d-4a28-bf38-5cb5c917f00a req-011f2c95-cd22-4086-99c3-2ee2824221e0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310998 Aug 02 09:51:54.822984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2382/4131] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:51:54.833533 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:54.834853 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:54.847483 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:54.848439 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:54.849890 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:54.850780 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:54.990101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:55.001850 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f8fabe3f-1215-4a81-a9a1-18c953277b9a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 200 len: 1372 microversion: 2.1 time: 0.176933 Aug 02 09:51:55.002688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2383/4132] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:54 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:55.061284 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-805a0d0c-987e-4f3b-bc57-ba8ca6498266 req-e460156e-902c-42bb-a61e-3a7bc7ed324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65316188-d82a-4300-b070-429295684ae2", "name": "network-vif-deleted", "tag": "5f2c3b1a-005f-4917-9d01-fa0a98414c5a"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:51:55.077105 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-805a0d0c-987e-4f3b-bc57-ba8ca6498266 req-e460156e-902c-42bb-a61e-3a7bc7ed324b service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:55.077612 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-805a0d0c-987e-4f3b-bc57-ba8ca6498266 req-e460156e-902c-42bb-a61e-3a7bc7ed324b service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:55.098980 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-805a0d0c-987e-4f3b-bc57-ba8ca6498266 req-e460156e-902c-42bb-a61e-3a7bc7ed324b service nova] Creating event network-vif-deleted:5f2c3b1a-005f-4917-9d01-fa0a98414c5a for instance 65316188-d82a-4300-b070-429295684ae2 on hv-cinder-80382 Aug 02 09:51:55.109359 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-805a0d0c-987e-4f3b-bc57-ba8ca6498266 req-e460156e-902c-42bb-a61e-3a7bc7ed324b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309990 Aug 02 09:51:55.110135 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1750/4133] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:51:55.496567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:55.497136 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:55.503938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:55.504441 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:55.505248 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:55.505727 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:55.554252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:55.554997 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:55.555788 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lazy-loading 'fault' on Instance uuid 65316188-d82a-4300-b070-429295684ae2 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:51:55.642346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:55.658763 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c11ca6c8-4d00-4200-ada4-0c6fdd950d04 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 200 len: 1316 microversion: 2.1 time: 0.167650 Aug 02 09:51:55.673323 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2384/4134] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:55 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:56.167507 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:56.169445 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:56.176988 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.177504 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.178291 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.178722 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.195417 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] HTTP exception thrown: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Request method failure captured: Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 HTTP/1.1 Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OqSrcWiRfeZTW7iYhPzTPPSdqIcifkpr9hQ3LmmIj8fdA1CInQDVsOrAOCfXrMKm43iAcKm9L_05ng1-a3FzL5WiI_GZceXMDhGwauN33CTW3HNqiHCzh365drhZ0XkamtJWGBxaRHeofmm-t8j9hpFQd-WxfpcFcHwrkHzNFSy4Gs Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:51:56.197239 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e2757dae0d3a45a29427faed00e98996"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 18728d1c3451497480556461b4ec80d5 Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:51:56.199190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '50686e38-723f-480e-9e37-f2d5e9eaaaf0'} Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:51:56.199916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:51:56.200916 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.202603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Returning 404 to user: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:51:56.202603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-43c3c490-4c7b-4f54-b9ef-42d323197ada tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 404 len: 111 microversion: 2.1 time: 0.162422 Aug 02 09:51:56.202603 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1751/4135] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:56 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:51:56.209892 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8e1b21d5-38ab-421b-a732-11a10f23ed61 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '.version_select at 0x7f8c1373b5e0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:56.239465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8e1b21d5-38ab-421b-a732-11a10f23ed61 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685715602" status: 202 len: 0 microversion: 2.1 time: 0.033827 Aug 02 09:51:56.240197 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2385/4136] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685715602 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:51:56.681238 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:56.682010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 65316188-d82a-4300-b070-429295684ae2] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:56.690098 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.690680 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.691558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.692091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.710864 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] HTTP exception thrown: Instance 65316188-d82a-4300-b070-429295684ae2 could not be found. Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Request method failure captured: Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 HTTP/1.1 Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OoxdLjv3CsKs-lcNPV6JkskJP3ZAhnpNxfIhXLfcSRed6FEQoeIGTw_CTD4Wl-T03HTedRO6XpyZOASSq1OEbtEFjk4pxMbRMgyAH6FUbIPfOrocInkzRB2X91ZY5INBbVPBem3mJnllakvGRnZHUODkaWSXh__vyRW56nNV0hE86g Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:51:56.712887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 6c30f2ab48e74d4690aafe46c4bf682f Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 65316188-d82a-4300-b070-429295684ae2 could not be found. Aug 02 09:51:56.715214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '65316188-d82a-4300-b070-429295684ae2'} Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65316188-d82a-4300-b070-429295684ae2 could not be found. Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:51:56.716551 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65316188-d82a-4300-b070-429295684ae2 could not be found. Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65316188-d82a-4300-b070-429295684ae2 could not be found. Aug 02 09:51:56.718579 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:51:56.719581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Returning 404 to user: Instance 65316188-d82a-4300-b070-429295684ae2 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:51:56.719581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7fcf6ad0-1823-474b-ba6e-3c589c3b92b4 tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2" status: 404 len: 111 microversion: 2.1 time: 0.038111 Aug 02 09:51:56.719581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1752/4137] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:56 2022] GET /compute/v2.1/servers/65316188-d82a-4300-b070-429295684ae2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:51:56.727106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:56.727926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:56.740614 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.741627 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.743098 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.743791 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.803006 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:51:56.962451 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34bfc1c2-b0e7-4966-af5f-64f00253b5dd tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "DELETE /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 204 len: 0 microversion: 2.1 time: 0.239543 Aug 02 09:51:56.963285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2386/4138] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:51:56 2022] DELETE /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:51:56.974264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:56.975381 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:56.984301 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.984780 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:56.985637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:56.986071 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:57.642594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:57.658077 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-564b6d16-d10c-4ce9-a743-58ea6fdf198f tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1523 microversion: 2.1 time: 0.688421 Aug 02 09:51:57.659011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1753/4139] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:56 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1523 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:57.736421 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-766de51e-81db-4fe8-8d8f-948f48d93a18 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: .version_select at 0x7f8c136fa820>, body: {"keypair": {"name": "tempest-keypair-766621089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIYu3XIiwFPgJAW+sdtJYnDN6Dj+3a/XgVewSjRLLNoqV4dOGsyJFMuX+p5quBjf4IZ4GEF9APch03OOKS2+o3x2Xp0oQLFUiT7LBIyPWgYvjdzH+dhH2dIj+8+/s67jQ=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:51:57.756208 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-766de51e-81db-4fe8-8d8f-948f48d93a18 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for project e2757dae0d3a45a29427faed00e98996. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:51:57.766712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-766de51e-81db-4fe8-8d8f-948f48d93a18 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for user 18728d1c3451497480556461b4ec80d5 and project e2757dae0d3a45a29427faed00e98996. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:51:57.802342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-766de51e-81db-4fe8-8d8f-948f48d93a18 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069735 Aug 02 09:51:57.805256 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2387/4140] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:51:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:51:58.323607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-8114e668-45ba-4f24-af8d-eb56f01f92aa req-09cdb551-5ef2-4e25-8203-1e465aef0a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f2099-d867-4685-a8b8-2c037bd7d3fd", "name": "network-vif-deleted", "tag": "48bebb2e-2ecc-45c9-af36-5a310b8692ff"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:51:58.341496 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-8114e668-45ba-4f24-af8d-eb56f01f92aa req-09cdb551-5ef2-4e25-8203-1e465aef0a33 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:58.342666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-8114e668-45ba-4f24-af8d-eb56f01f92aa req-09cdb551-5ef2-4e25-8203-1e465aef0a33 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:58.362228 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-8114e668-45ba-4f24-af8d-eb56f01f92aa req-09cdb551-5ef2-4e25-8203-1e465aef0a33 service nova] Creating event network-vif-deleted:48bebb2e-2ecc-45c9-af36-5a310b8692ff for instance 825f2099-d867-4685-a8b8-2c037bd7d3fd on hv-cinder-80382 Aug 02 09:51:58.376639 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-8114e668-45ba-4f24-af8d-eb56f01f92aa req-09cdb551-5ef2-4e25-8203-1e465aef0a33 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057369 Aug 02 09:51:58.377529 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1754/4141] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:51:58.685100 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:58.685878 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:58.693191 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:58.693654 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:58.694444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:58.694888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:58.729684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:58.730868 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:58.731478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lazy-loading 'fault' on Instance uuid 825f2099-d867-4685-a8b8-2c037bd7d3fd {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:51:58.790855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c30f2ab48e74d4690aafe46c4bf682f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279f631bf3db4ba7a0aff00226cf5724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:51:58.810071 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-b61e6dcc-1f39-48a2-ad2c-0d953742e3be tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 200 len: 1315 microversion: 2.1 time: 0.127012 Aug 02 09:51:58.810723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2388/4142] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:58 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 1315 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:51:59.634589 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-17565441", "imageRef": "f4d2e7ec-78dc-4f64-8d97-999991434282", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec67370-da38-4647-aa65-37564a860afd"}], "security_groups": [{"name": "tempest-securitygroup--822470092"}], "key_name": "tempest-keypair-766621089", "user_data": "}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:51:59.752953 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] validate_networks() for [('fec67370-da38-4647-aa65-37564a860afd', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:51:59.838639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:51:59.841410 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] [instance: 825f2099-d867-4685-a8b8-2c037bd7d3fd] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:51:59.852398 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:59.852855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:59.853692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:51:59.854127 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:51:59.874072 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] HTTP exception thrown: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd could not be found. Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Request method failure captured: Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd HTTP/1.1 Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OoxdLjv3CsKs-lcNPV6JkskJP3ZAhnpNxfIhXLfcSRed6FEQoeIGTw_CTD4Wl-T03HTedRO6XpyZOASSq1OEbtEFjk4pxMbRMgyAH6FUbIPfOrocInkzRB2X91ZY5INBbVPBem3mJnllakvGRnZHUODkaWSXh__vyRW56nNV0hE86g Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:51:59.876152 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/279f631bf3db4ba7a0aff00226cf5724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: 279f631bf3db4ba7a0aff00226cf5724 Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19119883 Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 6c30f2ab48e74d4690aafe46c4bf682f Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19119883-project Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd could not be found. Aug 02 09:51:59.879124 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '825f2099-d867-4685-a8b8-2c037bd7d3fd'} Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd could not be found. Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:51:59.880620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd could not be found. Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd could not be found. Aug 02 09:51:59.882665 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:51:59.890106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] Returning 404 to user: Instance 825f2099-d867-4685-a8b8-2c037bd7d3fd could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:51:59.890106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-cdb99767-402a-40de-b7f3-5aa3d521d7ba tempest-ServerRescueNegativeTestJSON-19119883 tempest-ServerRescueNegativeTestJSON-19119883-project] 10.222.0.100 "GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd" status: 404 len: 111 microversion: 2.1 time: 0.044866 Aug 02 09:51:59.890106 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2389/4143] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:51:59 2022] GET /compute/v2.1/servers/825f2099-d867-4685-a8b8-2c037bd7d3fd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:52:00.311811 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:52:00.312564 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:52:00.313491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:52:00.314250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:52:00.315050 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:52:00.329597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:00.330262 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:00.332573 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:00.333406 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:00.359338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for project e2757dae0d3a45a29427faed00e98996. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:52:00.363621 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Getting quotas for user 18728d1c3451497480556461b4ec80d5 and project e2757dae0d3a45a29427faed00e98996. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:52:00.377042 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:52:00.379785 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4d2e7ec-78dc-4f64-8d97-999991434282',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:52:00.440326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-cf870ba4-d860-46a3-b69b-1b49fea4f4f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.810852 Aug 02 09:52:00.441174 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1755/4144] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:51:59 2022] POST /compute/v2.1/servers => generated 403 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 02 09:52:00.455560 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-23dced7f-30d8-4a33-a7d1-0c90cabbd801 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:00.457007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-23dced7f-30d8-4a33-a7d1-0c90cabbd801 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:00.829429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-23dced7f-30d8-4a33-a7d1-0c90cabbd801 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:00.840429 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-23dced7f-30d8-4a33-a7d1-0c90cabbd801 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1239 microversion: 2.1 time: 0.391762 Aug 02 09:52:00.855473 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2390/4145] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:00 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1239 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:52:01.869332 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:01.871861 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:01.891054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:01.891834 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:01.893011 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:01.893477 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:01.961053 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:01.969349 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-22ef839d-b877-4892-988f-8c2590703eb1 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1297 microversion: 2.1 time: 0.109574 Aug 02 09:52:01.969915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1756/4146] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:01 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1297 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:02.992328 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:02.995803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:03.016500 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:03.017738 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:03.021549 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:03.021998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:03.319282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:03.336752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9b04c1b8-4eba-4616-8465-a9194cba183c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1364 microversion: 2.1 time: 0.347325 Aug 02 09:52:03.341719 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2391/4147] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:02 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:03.745724 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-0b2f653a-b81d-4625-8491-4befd7cc4458 req-4323dfb7-4f85-4f30-930c-06a0aa9972ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ebaedf-a5c4-4870-b491-b0d9bfb9cd02", "tag": "d0daf6f4-3100-4d60-abfe-27b01f0c356d"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:52:03.761152 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-0b2f653a-b81d-4625-8491-4befd7cc4458 req-4323dfb7-4f85-4f30-930c-06a0aa9972ca service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:03.764059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-0b2f653a-b81d-4625-8491-4befd7cc4458 req-4323dfb7-4f85-4f30-930c-06a0aa9972ca service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:03.778447 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-0b2f653a-b81d-4625-8491-4befd7cc4458 req-4323dfb7-4f85-4f30-930c-06a0aa9972ca service nova] Creating event network-changed:d0daf6f4-3100-4d60-abfe-27b01f0c356d for instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 on hv-cinder-80382 Aug 02 09:52:03.785339 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-0b2f653a-b81d-4625-8491-4befd7cc4458 req-4323dfb7-4f85-4f30-930c-06a0aa9972ca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046945 Aug 02 09:52:03.786985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1757/4148] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:52:04.362202 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:04.363090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:04.389811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:04.390185 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:04.391295 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:04.392022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:04.642648 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:04.651307 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5c8498d7-520f-43df-a958-cc5a1e5414e6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1364 microversion: 2.1 time: 0.292927 Aug 02 09:52:04.665023 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2392/4149] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:04 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:52:05.677891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:05.679208 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:05.688787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:05.689275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:05.690059 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:05.690506 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:05.869375 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:05.878816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-60bda6e4-0ee2-4090-b3e7-59929945d438 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1364 microversion: 2.1 time: 0.208485 Aug 02 09:52:05.879398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1758/4150] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:05 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:52:06.914456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:06.915133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:06.922895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:06.923360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:06.924203 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:06.925234 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:07.071192 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:07.079776 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bcf50808-0147-40de-8cbd-22dba8313e5f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1364 microversion: 2.1 time: 0.169270 Aug 02 09:52:07.080367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2393/4151] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:06 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:07.530799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-69ff9c5a-0572-4039-9f49-4d5c6953fafa tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1c04a790>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:07.591999 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-69ff9c5a-0572-4039-9f49-4d5c6953fafa tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/bcf12ef1-0dec-4431-9c43-970583157da8" status: 200 len: 350 microversion: 2.1 time: 0.065918 Aug 02 09:52:07.592563 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1759/4152] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:52:07 2022] GET /compute/v2.1/os-volumes/bcf12ef1-0dec-4431-9c43-970583157da8 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:08.102863 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:08.103905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:08.112329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:08.112956 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:08.113912 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:08.114418 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:08.119581 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:08.298568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:08.306498 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a204a671-d235-4a12-8b8f-48fb123ec597 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1364 microversion: 2.1 time: 0.208550 Aug 02 09:52:08.307967 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2394/4153] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:08 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:08.360083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-1254d5dd-b43a-4283-86e8-c801a4496412 req-3336565f-f759-41c3-b338-7c16f2058a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebaedf-a5c4-4870-b491-b0d9bfb9cd02", "name": "network-vif-plugged", "status": "completed", "tag": "d0daf6f4-3100-4d60-abfe-27b01f0c356d"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:52:08.370976 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-1254d5dd-b43a-4283-86e8-c801a4496412 req-3336565f-f759-41c3-b338-7c16f2058a6d service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:08.371491 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-1254d5dd-b43a-4283-86e8-c801a4496412 req-3336565f-f759-41c3-b338-7c16f2058a6d service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:08.382798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-1254d5dd-b43a-4283-86e8-c801a4496412 req-3336565f-f759-41c3-b338-7c16f2058a6d service nova] Creating event network-vif-plugged:d0daf6f4-3100-4d60-abfe-27b01f0c356d for instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 on hv-cinder-80382 Aug 02 09:52:08.387839 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-1254d5dd-b43a-4283-86e8-c801a4496412 req-3336565f-f759-41c3-b338-7c16f2058a6d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210844 Aug 02 09:52:08.388433 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1760/4154] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:09.001600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-34d55185-4d7b-4bfa-9e2c-b98422b022d2 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c136ef940>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:09.057756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-34d55185-4d7b-4bfa-9e2c-b98422b022d2 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/6b44eefc-6184-4320-b0f4-36f348653faa" status: 200 len: 350 microversion: 2.1 time: 0.062547 Aug 02 09:52:09.058335 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2395/4155] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:52:08 2022] GET /compute/v2.1/os-volumes/6b44eefc-6184-4320-b0f4-36f348653faa => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:09.335453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:09.335453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:09.343297 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:09.343881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:09.344952 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:09.345948 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:09.534094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:09.543700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6d13c049-c233-4e1f-9dca-f7016a47d4cd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1364 microversion: 2.1 time: 0.217287 Aug 02 09:52:09.543897 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1761/4156] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:09 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:10.481858 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-342929c4-21b8-48d3-b9ad-56c6bb61ba4d tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1372e790>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.530599 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-342929c4-21b8-48d3-b9ad-56c6bb61ba4d tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/4fbbe84a-ed62-46e5-94da-322a4e01a73b" status: 200 len: 351 microversion: 2.1 time: 0.054366 Aug 02 09:52:10.531189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2396/4157] 10.222.0.100 () {58 vars in 1250 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/os-volumes/4fbbe84a-ed62-46e5-94da-322a4e01a73b => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:10.544317 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-fa751d7e-d23d-46c6-a2ed-8a8ce11cd260 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1820da60>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.553270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:10.554025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:10.576998 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.578154 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:10.588692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:10.589435 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:10.590246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:10.590684 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:10.650026 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-fa751d7e-d23d-46c6-a2ed-8a8ce11cd260 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.109697 Aug 02 09:52:10.653787 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1762/4158] 10.222.0.100 () {58 vars in 1139 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:10.673660 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-07d96f02-bab2-457b-842f-e3143688bcac tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1c0acd30>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.780210 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:52:10.788795 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c29e816c-65fe-4795-a04b-9823de67bb6c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1550 microversion: 2.1 time: 0.219320 Aug 02 09:52:10.789646 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2397/4159] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1550 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:52:10.800172 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-07d96f02-bab2-457b-842f-e3143688bcac tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.133951 Aug 02 09:52:10.800737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1763/4160] 10.222.0.100 () {58 vars in 1154 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:10.813619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.814213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:10.815732 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b24d7dee-b566-457e-a355-de4bd68a1071 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c180380d0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.820739 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:10.821237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:10.822020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:10.822462 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:10.836977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:10.898196 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b24d7dee-b566-457e-a355-de4bd68a1071 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087018 Aug 02 09:52:10.898777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1764/4161] 10.222.0.100 () {58 vars in 1139 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:10.911632 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-146f2ca1-c94d-4768-9da3-96720d97778c tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c184f20d0>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:10.914437 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-fd854a7c-ad76-4f38-9dc8-60a4866f39f4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104741 Aug 02 09:52:10.922492 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2398/4162] 10.222.0.100 () {58 vars in 1280 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:52:11.006290 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-146f2ca1-c94d-4768-9da3-96720d97778c tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098406 Aug 02 09:52:11.006920 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1765/4163] 10.222.0.100 () {58 vars in 1172 bytes} [Tue Aug 2 09:52:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:52:11.023163 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-1d5c6c1b-74f1-49d0-9980-6cbad54822d4 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c18101b80>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:11.123235 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-1d5c6c1b-74f1-49d0-9980-6cbad54822d4 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104445 Aug 02 09:52:11.123930 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2399/4164] 10.222.0.100 () {58 vars in 1175 bytes} [Tue Aug 2 09:52:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:52:11.147852 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-98999172-1239-4090-b9a9-2411a1cd1484 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1c0ac310>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:11.252060 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-98999172-1239-4090-b9a9-2411a1cd1484 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.111572 Aug 02 09:52:11.252654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1766/4165] 10.222.0.100 () {58 vars in 1160 bytes} [Tue Aug 2 09:52:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:11.266036 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-27e9a82a-7d61-44a9-91ce-d24ce4d8663d tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1372eca0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:11.356578 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-27e9a82a-7d61-44a9-91ce-d24ce4d8663d tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094252 Aug 02 09:52:11.357189 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2400/4166] 10.222.0.100 () {58 vars in 1193 bytes} [Tue Aug 2 09:52:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:11.371476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d6e7c121-6673-4f34-a437-932249a289c1 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] Calling method '.version_select at 0x7f8c1c05ae50>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:11.658101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d6e7c121-6673-4f34-a437-932249a289c1 tempest-VolumesTestJSON-1610233107 tempest-VolumesTestJSON-1610233107-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.290641 Aug 02 09:52:11.661055 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1767/4167] 10.222.0.100 () {58 vars in 1160 bytes} [Tue Aug 2 09:52:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:52:12.318870 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-160c79df-48b0-4129-ada6-8e083699775a req-210e1298-0e61-47b6-a9de-95ad969dcb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ebaedf-a5c4-4870-b491-b0d9bfb9cd02", "tag": "d0daf6f4-3100-4d60-abfe-27b01f0c356d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:52:12.333358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-160c79df-48b0-4129-ada6-8e083699775a req-210e1298-0e61-47b6-a9de-95ad969dcb2a service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:12.333813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-160c79df-48b0-4129-ada6-8e083699775a req-210e1298-0e61-47b6-a9de-95ad969dcb2a service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:12.346042 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-160c79df-48b0-4129-ada6-8e083699775a req-210e1298-0e61-47b6-a9de-95ad969dcb2a service nova] Creating event network-changed:d0daf6f4-3100-4d60-abfe-27b01f0c356d for instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 on hv-cinder-80382 Aug 02 09:52:12.351285 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-160c79df-48b0-4129-ada6-8e083699775a req-210e1298-0e61-47b6-a9de-95ad969dcb2a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037323 Aug 02 09:52:12.351909 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2401/4168] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:48.354425 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:48.355607 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=56 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:48.364270 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:48.365413 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:48.386637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:48.387514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:48.388783 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:48.389716 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:48.416915 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-af7073a4-51c1-4c2a-bd7b-7f35e30d39a0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/ips" status: 200 len: 146 microversion: 2.1 time: 0.064713 Aug 02 09:52:48.417531 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1768/4169] 10.222.0.100 () {58 vars in 1253 bytes} [Tue Aug 2 09:52:48 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/ips => generated 146 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:52:49.981772 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "637d7732-9962-44d2-8cff-c4029ed8c239"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:52:49.985342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:49.995077 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:49.996102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=16 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:52:49.999742 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:50.000554 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:50.001698 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:50.002486 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:50.437073 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:52:50.438841 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:52:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:52:50.452927 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-688835cf-d9f1-43fb-9307-5b343e6774be tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476626 Aug 02 09:52:50.454292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2402/4170] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:52:49 2022] POST /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:52:58.359283 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:58.375469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:58.384020 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:58.385592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:58.386668 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:58.387343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:58.429489 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-d76f7330-a907-43c3-8a41-bc651b67acba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084048 Aug 02 09:52:58.432225 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1769/4171] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:52:58 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:52:58.445021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:52:58.445021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:52:58.452503 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:58.452977 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:58.467548 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:52:58.468007 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:52:58.523252 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d0330bcc-4aec-417b-b103-16fecc802819 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/637d7732-9962-44d2-8cff-c4029ed8c239" status: 200 len: 194 microversion: 2.1 time: 0.083961 Aug 02 09:52:58.530382 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2403/4172] 10.222.0.100 () {58 vars in 1418 bytes} [Tue Aug 2 09:52:58 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/637d7732-9962-44d2-8cff-c4029ed8c239 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:00.080675 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ff88b00-626d-45bc-8289-00a1286aa306"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:00.083594 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:00.091347 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:00.092046 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:00.092862 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:00.093344 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:00.504876 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a091c2b6-64d0-4d2c-a781-8a5b40c1f44d tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "POST /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428164 Aug 02 09:53:00.506186 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1770/4173] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:53:00 2022] POST /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:08.036705 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-d5d40215-d58d-49bf-ac33-a46329d2d9ea tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Action: 'create', calling method: .version_select at 0x7f8c1370b790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2070207901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4yFxCNe93rMaAg4KHyC2+rlWLxE3BnxlRzdwTYjqCh9oRsSA0E82nsmmGt5GN2m0Ibe6R7bMgNN2V1/Q7CJAv//IhBpkh+koWWO51o+JZzDYW4MKecgaVi1QdcAlX1Pw=="}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:08.053237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-d5d40215-d58d-49bf-ac33-a46329d2d9ea tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Getting quotas for project 557cbe65acb94a749a05118b3f3b70ff. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:53:08.058688 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.quota [None req-d5d40215-d58d-49bf-ac33-a46329d2d9ea tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Getting quotas for user 0ea7a204b1d34f7dacfe9f468f565e65 and project 557cbe65acb94a749a05118b3f3b70ff. Resources: {'key_pairs'} {{(pid=117908) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:53:08.085026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-d5d40215-d58d-49bf-ac33-a46329d2d9ea tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052244 Aug 02 09:53:08.085676 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2404/4174] 10.222.0.100 () {60 vars in 1164 bytes} [Tue Aug 2 09:53:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:08.150157 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1004670504", "imageRef": "010a83bd-bb0a-4c73-a760-a077cca8811b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2070207901", "networks": [{"uuid": "ec435b69-47dc-42b3-8e65-86e69ce19441"}]}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:08.213201 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.network.neutron [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] validate_networks() for [('ec435b69-47dc-42b3-8e65-86e69ce19441', None, None, None, None, None)] {{(pid=117909) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:53:08.289592 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:08.291926 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:08.299459 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.299905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.300710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.301166 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.346099 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-55f36610-041d-44cf-99c4-a691e7eef7e0 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060850 Aug 02 09:53:08.346711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2405/4175] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:53:08 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:53:08.494034 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:08.494455 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:08.500949 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.501447 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.502229 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.502667 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.536454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-affb648c-75f9-4d29-91f7-ad10a8a813b4 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/637d7732-9962-44d2-8cff-c4029ed8c239" status: 200 len: 194 microversion: 2.1 time: 0.047410 Aug 02 09:53:08.537088 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2406/4176] 10.222.0.100 () {58 vars in 1418 bytes} [Tue Aug 2 09:53:08 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/637d7732-9962-44d2-8cff-c4029ed8c239 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:53:08.557299 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:08.557817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:08.564734 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.565228 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.566232 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.566464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.657877 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lazy-loading 'services' on Instance uuid 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:53:08.739068 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5c01bb81-ca23-4542-ad4e-77a4e87461a8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/637d7732-9962-44d2-8cff-c4029ed8c239" status: 202 len: 0 microversion: 2.1 time: 0.189518 Aug 02 09:53:08.739683 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2407/4177] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:53:08 2022] DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/637d7732-9962-44d2-8cff-c4029ed8c239 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:53:08.938069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Flavor limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:53:08.938497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Image limits 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:53:08.938973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Flavor pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:53:08.939387 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Image pref 0:0:0 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:53:08.939838 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.virt.hardware [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:53:08.950759 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.951203 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.952009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:08.952449 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:08.969947 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Getting quotas for project 557cbe65acb94a749a05118b3f3b70ff. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:53:08.974918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.quota [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Getting quotas for user 0ea7a204b1d34f7dacfe9f468f565e65 and project 557cbe65acb94a749a05118b3f3b70ff. Resources: {'cores', 'instances', 'ram'} {{(pid=117909) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:53:08.986356 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Going to run 1 instances... {{(pid=117909) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:53:08.988674 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='010a83bd-bb0a-4c73-a760-a077cca8811b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:53:09.041440 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-137fb783-8d5c-4bbe-be43-f46f4e9408f0 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.896415 Aug 02 09:53:09.042110 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1771/4178] 10.222.0.100 () {60 vars in 1152 bytes} [Tue Aug 2 09:53:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 09:53:09.053900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-8630133a-1088-4683-b3a0-80a6e32761cb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:09.055233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-8630133a-1088-4683-b3a0-80a6e32761cb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:09.118817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-8630133a-1088-4683-b3a0-80a6e32761cb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:09.126617 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-8630133a-1088-4683-b3a0-80a6e32761cb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1263 microversion: 2.1 time: 0.077264 Aug 02 09:53:09.127282 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2408/4179] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:09 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:09.895005 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:09.895599 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:09.903985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:09.904890 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:09.905990 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:09.906512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:09.939649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-eceaddd2-c7df-4fbb-a06c-6b7e8df316ba tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/8ff88b00-626d-45bc-8289-00a1286aa306" status: 200 len: 194 microversion: 2.1 time: 0.048641 Aug 02 09:53:09.940251 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1772/4180] 10.222.0.100 () {58 vars in 1418 bytes} [Tue Aug 2 09:53:09 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/8ff88b00-626d-45bc-8289-00a1286aa306 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:09.953331 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:09.953862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:09.962112 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:09.962556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:09.963332 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:09.963861 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:10.058080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.objects.instance [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lazy-loading 'services' on Instance uuid 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 {{(pid=117908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:53:10.149254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-010b62a1-bb2d-4784-bd80-c6b56df71263 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/8ff88b00-626d-45bc-8289-00a1286aa306" status: 202 len: 0 microversion: 2.1 time: 0.199985 Aug 02 09:53:10.150079 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2409/4181] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:53:09 2022] DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments/8ff88b00-626d-45bc-8289-00a1286aa306 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:53:10.153099 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:10.153816 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:10.160663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:10.161341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:10.162248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:10.162986 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:10.288605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:10.300877 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e3d3d9a2-cf3f-484f-973d-840d7a8c7b75 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1323 microversion: 2.1 time: 0.151808 Aug 02 09:53:10.303035 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1773/4182] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:10 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:11.349458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:11.349458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:11.383862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.384342 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.385233 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.385701 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.495497 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:11.504436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:11.515199 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.516169 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.518175 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.518667 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.556943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1efa296a-3f01-4566-b710-d4ecb0fcec82 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066597 Aug 02 09:53:11.557840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1774/4183] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:53:11 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:53:11.677812 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:11.690370 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a8337850-0486-4354-85b2-611904c27936 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.347847 Aug 02 09:53:11.691999 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2410/4184] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:11 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:11.784045 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:11.786459 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:11.793654 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.794453 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.795588 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.796275 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.832871 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4d21d233-0a9d-4d23-95ad-e35de2577bf9 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052720 Aug 02 09:53:11.834250 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1775/4185] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:53:11 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:53:11.936085 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:11.936920 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:11.945010 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.946369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.947527 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:11.948213 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:11.983593 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:53:12.147994 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e04c8e82-143f-4393-924f-80341057a102 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 204 len: 0 microversion: 2.1 time: 0.215245 Aug 02 09:53:12.158847 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2411/4186] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:53:11 2022] DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:53:12.164863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:12.165853 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:12.173924 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:12.174863 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:12.175704 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:12.176350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:12.401903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:12.423054 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c0ee42c9-6057-442a-8aa3-f93fc4add9e5 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.263083 Aug 02 09:53:12.424296 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1776/4187] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:12 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:12.721386 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:12.723871 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:12.735608 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:12.736811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:12.738395 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:12.739346 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:12.920715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:12.928444 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-eba362b1-f8e8-4377-83d5-336bc391c751 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.216455 Aug 02 09:53:12.929055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2412/4188] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:12 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:13.448189 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:13.448918 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:13.463985 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:13.464438 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:13.471788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:13.472597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:13.763514 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:13.772082 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-7102373f-8971-42fc-a5fd-314e620147c6 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.329529 Aug 02 09:53:13.772902 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1777/4189] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:13 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:13.950888 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:13.951532 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:13.959207 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:13.959710 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:13.960499 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:13.961752 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:14.201803 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:14.213898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-33a70250-0c50-4e46-b300-79f9dee20bdc tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.267040 Aug 02 09:53:14.216345 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2413/4190] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:13 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:14.795649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:14.796338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:14.803733 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:14.804116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:14.805408 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:14.805856 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:14.976289 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:14.987886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c027cc34-586c-4c9f-a350-251bcb9b3639 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.196102 Aug 02 09:53:14.988663 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1778/4191] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:14 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:15.249262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:15.250220 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:15.261900 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:15.262805 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:15.264741 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:15.265715 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:15.464138 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:15.485619 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-c8e4415e-bdd8-47b9-9dda-be80c3e9033f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.243711 Aug 02 09:53:15.486829 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2414/4192] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:15 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:16.032690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:16.032690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:16.032690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:16.032690 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:16.034116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:16.034116 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:16.241541 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:16.250165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-dc3ea966-0da2-473c-80cc-8f126fb29041 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.236748 Aug 02 09:53:16.250740 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1779/4193] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:16 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:16.529051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:16.530057 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:16.538148 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:16.539266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:16.540161 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:16.540600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:16.723253 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:16.739292 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ada2936e-1127-4062-b1d3-525ce66b1ab6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.214602 Aug 02 09:53:16.740022 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2415/4194] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:16 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:17.283090 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:17.284749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:17.302706 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:17.305763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:17.308555 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:17.309868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:17.537575 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:17.547351 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6569d232-6987-4edd-9b24-5071fd86114c tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.275964 Aug 02 09:53:17.548261 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1780/4195] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:17 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:17.772406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:17.775824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:17.791747 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:17.792204 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:17.792982 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:17.793452 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:17.798169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:17.946312 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:17.953938 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a7957896-38c3-4e93-9355-7d6c4e28fa4a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.189209 Aug 02 09:53:17.954502 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2416/4196] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:17 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:18.581103 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:18.582935 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:18.590286 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:18.600019 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:18.600798 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:18.602940 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:18.603743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:18.610101 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:18.803374 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:18.812416 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ab5346fc-86fb-477d-b1df-a4b5b133eae8 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.241327 Aug 02 09:53:18.812965 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1781/4197] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:18 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:18.982021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:18.983411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:18.995366 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:18.996125 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:18.997460 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:18.998404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:19.125508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=6 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:19.156056 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:19.163810 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-359d8bfa-ee20-473a-9dcc-7acdaf96ebd2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.191247 Aug 02 09:53:19.165055 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2417/4198] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:18 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:19.843610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:19.844678 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:19.854393 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=2 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:19.855479 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell0:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:19.858461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:19.859341 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:19.860461 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:19.861168 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:20.025009 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:20.035630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-6f243667-8410-4db3-a5b3-2c8598553f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.197816 Aug 02 09:53:20.036512 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1782/4199] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:19 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:20.188020 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:20.194357 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:20.198478 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:20.210160 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:20.211465 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:20.212663 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:20.213329 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:20.414268 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:20.422179 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-ce42a526-befe-4222-960b-632bb5f4d832 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.239306 Aug 02 09:53:20.422755 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2418/4200] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:20 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:21.071849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:21.072508 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:21.079616 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:21.080065 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:21.080929 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:21.081903 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:21.246235 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:21.260534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-68d06024-3a76-4314-a166-3382d69e5f68 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.196179 Aug 02 09:53:21.261630 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1783/4201] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:21 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:21.449883 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:21.451176 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:21.466530 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:21.466983 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:21.467764 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:21.468314 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:21.662075 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:21.673011 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-647c7f83-ce5e-4467-b445-25332498b5e6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.230789 Aug 02 09:53:21.673531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2419/4202] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:21 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:22.285914 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-cc123583-4fef-492c-acaf-2f76555dd85a req-bb948321-507e-4431-a8aa-d38b47a4cea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:22.295795 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-cc123583-4fef-492c-acaf-2f76555dd85a req-bb948321-507e-4431-a8aa-d38b47a4cea1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:22.296306 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:22.296502 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-cc123583-4fef-492c-acaf-2f76555dd85a req-bb948321-507e-4431-a8aa-d38b47a4cea1 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:22.297655 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:22.305568 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:22.306273 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:22.307219 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:22.307830 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:22.309074 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-cc123583-4fef-492c-acaf-2f76555dd85a req-bb948321-507e-4431-a8aa-d38b47a4cea1 service nova] Creating event network-changed:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:53:22.314340 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-cc123583-4fef-492c-acaf-2f76555dd85a req-bb948321-507e-4431-a8aa-d38b47a4cea1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Aug 02 09:53:22.314934 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1784/4203] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:22.459325 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:22.467318 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-309d15f1-a94f-40ae-99e8-de0269d70408 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.178963 Aug 02 09:53:22.467898 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2420/4204] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:22 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:22.697746 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:22.698458 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:22.705012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:22.705505 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:22.706285 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:22.706802 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:22.843280 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:22.851402 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f5940201-961c-4375-ba02-0c01138e0e48 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.157806 Aug 02 09:53:22.851978 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1785/4205] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:22 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:23.489405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:23.490132 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:23.497936 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:23.498647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:23.499669 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:23.500354 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:23.807190 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:23.818130 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-a99f78d3-e915-4572-b0b4-2520252a4bc7 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1675 microversion: 2.1 time: 0.333633 Aug 02 09:53:23.818854 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2421/4206] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:23 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1675 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:23.877213 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:23.878799 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:23.889777 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:23.890618 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:23.891591 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:23.892025 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:24.108338 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:24.116868 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-9369c500-0a88-4640-8bd9-f749a14c239e tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.244041 Aug 02 09:53:24.117515 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1786/4207] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:23 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:24.341576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-61009672-237f-44d0-88b3-e29eff0b3d28 req-cf665279-b3a5-4f07-a728-7fb26a0939b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebaedf-a5c4-4870-b491-b0d9bfb9cd02", "name": "network-vif-deleted", "tag": "d0daf6f4-3100-4d60-abfe-27b01f0c356d"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:24.358063 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-61009672-237f-44d0-88b3-e29eff0b3d28 req-cf665279-b3a5-4f07-a728-7fb26a0939b4 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:24.358748 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-61009672-237f-44d0-88b3-e29eff0b3d28 req-cf665279-b3a5-4f07-a728-7fb26a0939b4 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:24.376087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-61009672-237f-44d0-88b3-e29eff0b3d28 req-cf665279-b3a5-4f07-a728-7fb26a0939b4 service nova] Creating event network-vif-deleted:d0daf6f4-3100-4d60-abfe-27b01f0c356d for instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 on hv-cinder-80382 Aug 02 09:53:24.383882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-61009672-237f-44d0-88b3-e29eff0b3d28 req-cf665279-b3a5-4f07-a728-7fb26a0939b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048157 Aug 02 09:53:24.385339 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2422/4208] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:24.843248 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:24.843886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:24.856619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:24.858467 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:24.859115 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:24.859906 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:24.931386 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:24.933190 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:24.933849 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lazy-loading 'fault' on Instance uuid 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:53:24.985069 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18728d1c3451497480556461b4ec80d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2757dae0d3a45a29427faed00e98996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:24.994313 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-13e4d72e-098b-463f-a57a-f8f73ed923fd tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 200 len: 1329 microversion: 2.1 time: 0.154918 Aug 02 09:53:24.994887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1787/4209] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:24 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 1329 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:25.142367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:25.143884 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:25.154711 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:25.155173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:25.156450 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:25.156929 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:25.363392 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:25.373361 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-792b883f-1918-4a76-9e94-7766d851b8ae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.236434 Aug 02 09:53:25.374454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2423/4210] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:25 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:26.028410 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:26.029033 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:26.035896 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:26.036350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:26.037146 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:26.037592 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:26.051776 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] HTTP exception thrown: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Request method failure captured: Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 HTTP/1.1 Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OqSrcWiRfeZTW7iYhPzTPPSdqIcifkpr9hQ3LmmIj8fdA1CInQDVsOrAOCfXrMKm43iAcKm9L_05ng1-a3FzL5WiI_GZceXMDhGwauN33CTW3HNqiHCzh365drhZ0XkamtJWGBxaRHeofmm-t8j9hpFQd-WxfpcFcHwrkHzNFSy4Gs Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:53:26.053476 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e2757dae0d3a45a29427faed00e98996"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 18728d1c3451497480556461b4ec80d5 Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:26.055525 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '15ebaedf-a5c4-4870-b491-b0d9bfb9cd02'} Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:53:26.056299 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:26.058027 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:26.059558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Returning 404 to user: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:53:26.059558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b0c80af4-5d5a-46f5-b333-714ae1ba9f4e tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 404 len: 111 microversion: 2.1 time: 0.034280 Aug 02 09:53:26.059558 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1788/4211] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:26 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:53:26.065254 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f3acf3a8-4956-4d13-98f3-79eb1002ff4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '.version_select at 0x7f8c1c106dc0>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:26.090090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f3acf3a8-4956-4d13-98f3-79eb1002ff4a tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766621089" status: 202 len: 0 microversion: 2.1 time: 0.028891 Aug 02 09:53:26.090756 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2424/4212] 10.222.0.100 () {58 vars in 1223 bytes} [Tue Aug 2 09:53:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766621089 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:53:26.396311 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:26.397165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:26.407363 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:26.408350 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:26.409782 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:26.410606 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:26.625547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:26.635367 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-c74615d6-5241-4500-a1d7-153a6dc83ab1 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.242919 Aug 02 09:53:26.636475 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1789/4213] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:26 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:27.658902 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:27.659505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:27.667911 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:27.668358 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:27.669194 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:27.669628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:28.003378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:28.011583 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f012f8e2-1fa6-4642-8c8b-a85d456843c9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.357363 Aug 02 09:53:28.012178 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2425/4214] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:27 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:28.566901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-5b2c56fa-01ae-40c0-9502-45602788812d req-ebdfdbb7-c239-4230-9470-b8be9f5d8c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "name": "network-vif-plugged", "status": "completed", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:28.580337 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5b2c56fa-01ae-40c0-9502-45602788812d req-ebdfdbb7-c239-4230-9470-b8be9f5d8c86 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:28.581148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-5b2c56fa-01ae-40c0-9502-45602788812d req-ebdfdbb7-c239-4230-9470-b8be9f5d8c86 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:28.600111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-5b2c56fa-01ae-40c0-9502-45602788812d req-ebdfdbb7-c239-4230-9470-b8be9f5d8c86 service nova] Creating event network-vif-plugged:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:53:28.608737 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-5b2c56fa-01ae-40c0-9502-45602788812d req-ebdfdbb7-c239-4230-9470-b8be9f5d8c86 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046434 Aug 02 09:53:28.609649 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1790/4215] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:29.036169 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:29.036889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:29.044108 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:29.044555 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:29.045369 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:29.045811 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:29.199984 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:29.208139 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-5c6a6815-79a4-4172-8a3f-95ec6a1ad40d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.176375 Aug 02 09:53:29.208737 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2426/4216] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:29 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:29.253435 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:29.254170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:29.267778 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:29.268240 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:29.269093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:29.269565 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:29.285246 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] HTTP exception thrown: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Request method failure captured: Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 HTTP/1.1 Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OqSrcWiRfeZTW7iYhPzTPPSdqIcifkpr9hQ3LmmIj8fdA1CInQDVsOrAOCfXrMKm43iAcKm9L_05ng1-a3FzL5WiI_GZceXMDhGwauN33CTW3HNqiHCzh365drhZ0XkamtJWGBxaRHeofmm-t8j9hpFQd-WxfpcFcHwrkHzNFSy4Gs Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:53:29.286946 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e2757dae0d3a45a29427faed00e98996"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 18728d1c3451497480556461b4ec80d5 Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.288355 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '15ebaedf-a5c4-4870-b491-b0d9bfb9cd02'} Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:53:29.289081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.290547 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.291901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Returning 404 to user: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:53:29.291901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-baa2a291-9878-443a-817a-92c51fa13d6f tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 404 len: 111 microversion: 2.1 time: 0.040315 Aug 02 09:53:29.291901 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1791/4217] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:53:29 2022] DELETE /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:53:29.302508 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:29.303262 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:29.313000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:29.313817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:29.315019 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:29.315468 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:29.330093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] HTTP exception thrown: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Request method failure captured: Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 HTTP/1.1 Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OqSrcWiRfeZTW7iYhPzTPPSdqIcifkpr9hQ3LmmIj8fdA1CInQDVsOrAOCfXrMKm43iAcKm9L_05ng1-a3FzL5WiI_GZceXMDhGwauN33CTW3HNqiHCzh365drhZ0XkamtJWGBxaRHeofmm-t8j9hpFQd-WxfpcFcHwrkHzNFSy4Gs Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:53:29.331828 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e2757dae0d3a45a29427faed00e98996"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 18728d1c3451497480556461b4ec80d5 Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.333567 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '15ebaedf-a5c4-4870-b491-b0d9bfb9cd02'} Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:53:29.335217 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. Aug 02 09:53:29.337579 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:29.339575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Returning 404 to user: Instance 15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:53:29.339575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-898df724-7da7-418d-a13f-1220140ba377 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02" status: 404 len: 111 microversion: 2.1 time: 0.036665 Aug 02 09:53:29.339575 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2427/4218] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:29 2022] GET /compute/v2.1/servers/15ebaedf-a5c4-4870-b491-b0d9bfb9cd02 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:53:30.238665 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:30.239469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:30.248788 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:30.249521 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:30.250803 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:30.251396 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:30.421577 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:30.432361 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-547b11d7-1aea-431d-8f22-9a4e158f8fff tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1363 microversion: 2.1 time: 0.197655 Aug 02 09:53:30.433040 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1792/4219] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:30 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:30.510340 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:30.510886 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:30.518173 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:30.518813 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:30.519732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:30.520288 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:30.534889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.wsgi [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] HTTP exception thrown: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Request method failure captured: Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: request: DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 HTTP/1.1 Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept: application/json Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Accept-Encoding: identity Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Connection: close Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Length: 0 Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Content-Type: application/json Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Host: 10.222.0.100 Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Openstack-System-Scope: None Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: User-Agent: python-urllib3/1.26.10 Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Auth-Token: gAAAAABi6OqSrcWiRfeZTW7iYhPzTPPSdqIcifkpr9hQ3LmmIj8fdA1CInQDVsOrAOCfXrMKm43iAcKm9L_05ng1-a3FzL5WiI_GZceXMDhGwauN33CTW3HNqiHCzh365drhZ0XkamtJWGBxaRHeofmm-t8j9hpFQd-WxfpcFcHwrkHzNFSy4Gs Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Id: None Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Domain-Name: None Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Identity-Status: Confirmed Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Is-Admin-Project: True Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Id: default Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Domain-Name: Default Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Project-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Role: member,reader Aug 02 09:53:30.536576 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Roles: member,reader Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e2757dae0d3a45a29427faed00e98996"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Id: default Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Domain-Name: Default Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Id: 18728d1c3451497480556461b4ec80d5 Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: X-User-Name: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: method: > Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: exception: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.538080 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: action_args: {'id': '50686e38-723f-480e-9e37-f2d5e9eaaaf0'} Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:53:30.539353 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.540824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.542115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Returning 404 to user: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. {{(pid=117908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:53:30.542115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-f89bb1f1-b5ec-4cd1-a15b-d9ad7c0a6d17 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 404 len: 111 microversion: 2.1 time: 0.032599 Aug 02 09:53:30.542115 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2428/4220] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:53:30 2022] DELETE /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:53:30.550012 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:30.550815 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] [instance: 50686e38-723f-480e-9e37-f2d5e9eaaaf0] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:30.559371 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:30.559830 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:30.560605 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:30.561083 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:30.576153 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] HTTP exception thrown: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Request method failure captured: Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 HTTP/1.1 Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6OqSrcWiRfeZTW7iYhPzTPPSdqIcifkpr9hQ3LmmIj8fdA1CInQDVsOrAOCfXrMKm43iAcKm9L_05ng1-a3FzL5WiI_GZceXMDhGwauN33CTW3HNqiHCzh365drhZ0XkamtJWGBxaRHeofmm-t8j9hpFQd-WxfpcFcHwrkHzNFSy4Gs Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:53:30.577949 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e2757dae0d3a45a29427faed00e98996"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e2757dae0d3a45a29427faed00e98996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: e2757dae0d3a45a29427faed00e98996 Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-305182369 Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 18728d1c3451497480556461b4ec80d5 Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-AttachVolumeTestJSON-305182369-project Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.579676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '50686e38-723f-480e-9e37-f2d5e9eaaaf0'} Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:53:30.580642 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. Aug 02 09:53:30.582389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:53:30.584242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] Returning 404 to user: Instance 50686e38-723f-480e-9e37-f2d5e9eaaaf0 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:53:30.584242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a1d5a0a4-e411-48f5-9f9d-bb5d52ef8340 tempest-AttachVolumeTestJSON-305182369 tempest-AttachVolumeTestJSON-305182369-project] 10.222.0.100 "GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0" status: 404 len: 111 microversion: 2.1 time: 0.033707 Aug 02 09:53:30.584242 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1793/4221] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:30 2022] GET /compute/v2.1/servers/50686e38-723f-480e-9e37-f2d5e9eaaaf0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:53:31.464095 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:31.464699 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:31.471093 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:31.471577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:31.472573 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:31.472959 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:31.704270 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:31.718635 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-0e8e348d-8081-4782-a452-6f2099cc010c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1554 microversion: 2.1 time: 0.266586 Aug 02 09:53:31.719851 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2429/4222] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:31 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1554 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:31.750683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:31.752264 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:31.760821 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:31.761295 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:31.762066 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:31.762687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:31.948245 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:31.957923 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-229d7f7e-5966-4992-a2bb-4be8e61e525d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1554 microversion: 2.1 time: 0.210753 Aug 02 09:53:31.959091 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1794/4223] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:31 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:31.983640 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:31.990980 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:31.992774 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Searching by: {'deleted': False, 'project_id': '557cbe65acb94a749a05118b3f3b70ff'} {{(pid=117908) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 09:53:32.001495 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:32.001950 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:32.003030 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:32.003471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:32.098995 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.multi_cell_list [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117908) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 09:53:32.193639 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-72ff8d87-174f-4059-8c4d-7752ce8378b5 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.215257 Aug 02 09:53:32.195026 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2430/4224] 10.222.0.100 () {58 vars in 1130 bytes} [Tue Aug 2 09:53:31 2022] GET /compute/v2.1/servers => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:32.206209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:32.206831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:32.213170 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:32.213637 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:32.214414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:32.214859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:32.458997 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:32.474809 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b891600a-c122-401d-a252-a78beb7565ca tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1554 microversion: 2.1 time: 0.271793 Aug 02 09:53:32.476702 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1795/4225] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:32 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1554 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:53:34.311471 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb0d3159-cb96-478a-a057-3513346b9cc2"}} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:34.315013 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:34.324642 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:34.325102 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:34.325895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:34.326512 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:34.964817 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-de114ebc-94b2-4987-be70-490053cebdce tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665122 Aug 02 09:53:34.965466 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2431/4226] 10.222.0.100 () {60 vars in 1328 bytes} [Tue Aug 2 09:53:34 2022] POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:42.712494 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:42.714683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:42.715943 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=31 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:42.716831 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=71 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:42.722739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:42.723187 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:42.723973 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:42.724404 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:43.055300 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:43.063358 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-47284fbd-3ed3-40e9-a252-a5e0aa63ef46 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1600 microversion: 2.1 time: 0.354964 Aug 02 09:53:43.063936 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1796/4227] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:42 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1600 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:53:45.140097 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell0:SELECT=2 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:45.141744 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:45.142895 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:53:45.149973 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-f8b956d6-7baa-40bd-95fd-296724032863 req-daf5378e-485f-4918-a376-79490b8ad44e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:45.166322 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-f8b956d6-7baa-40bd-95fd-296724032863 req-daf5378e-485f-4918-a376-79490b8ad44e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:45.166778 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-f8b956d6-7baa-40bd-95fd-296724032863 req-daf5378e-485f-4918-a376-79490b8ad44e service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:45.181641 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-f8b956d6-7baa-40bd-95fd-296724032863 req-daf5378e-485f-4918-a376-79490b8ad44e service nova] Creating event network-changed:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:53:45.196637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-f8b956d6-7baa-40bd-95fd-296724032863 req-daf5378e-485f-4918-a376-79490b8ad44e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048176 Aug 02 09:53:45.196637 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2432/4228] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:53:46.514442 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1626616720"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:46.515165 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:46.524602 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:46.525436 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:46.526766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:46.527511 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:46.669695 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.network.security_group_api [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Adding security group d11e1811-8b8b-499a-9552-7cb40e412b0d to port e4bc4604-b093-43bc-a60b-4e4fd30b9620 Aug 02 09:53:47.047490 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-a6a78f5c-8f37-475c-ba7e-8fdf3f202496 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/action" status: 202 len: 0 microversion: 2.1 time: 0.536880 Aug 02 09:53:47.048389 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1797/4229] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:53:46 2022] POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:53:47.058368 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:53:47.059094 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:53:47.065901 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:47.066365 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:47.067146 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:47.067577 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:47.202994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-fe30fc2b-5efe-4be3-b794-ce72c1af9b4c req-b8954f33-7f1c-42df-b910-ffdbc994bbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:53:47.214397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-fe30fc2b-5efe-4be3-b794-ce72c1af9b4c req-b8954f33-7f1c-42df-b910-ffdbc994bbe8 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:53:47.215260 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-fe30fc2b-5efe-4be3-b794-ce72c1af9b4c req-b8954f33-7f1c-42df-b910-ffdbc994bbe8 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:53:47.228728 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-fe30fc2b-5efe-4be3-b794-ce72c1af9b4c req-b8954f33-7f1c-42df-b910-ffdbc994bbe8 service nova] Creating event network-changed:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:53:47.239149 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-fe30fc2b-5efe-4be3-b794-ce72c1af9b4c req-b8954f33-7f1c-42df-b910-ffdbc994bbe8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040275 Aug 02 09:53:47.245001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1798/4230] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:53:47.258415 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:53:47.266802 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-806e4e9f-855c-403b-9ea2-84d0ed5d5bac tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1765 microversion: 2.1 time: 0.213787 Aug 02 09:53:47.267396 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2433/4231] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:53:47 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1765 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:04.273749 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=6 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:04.274766 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=12 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:04.278917 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:54:04.281391 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:04.289312 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:04.289756 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:04.290556 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:04.291001 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:04.376650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-172193c2-dd3f-43c2-a4a8-48ff8f7fbfb9 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/action" status: 202 len: 0 microversion: 2.1 time: 0.104221 Aug 02 09:54:04.381097 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1799/4232] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:54:04 2022] POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:54:04.386563 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:04.388375 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:04.391692 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=4 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:04.392707 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=8 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:04.399844 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:04.400374 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:04.401404 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:04.402067 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:04.678032 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:04.694236 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-489849cc-6965-427a-97f6-9ab079df75bb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1757 microversion: 2.1 time: 0.310937 Aug 02 09:54:04.695334 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2434/4233] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:04 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1757 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:54:05.721466 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:05.722701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:05.733003 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:05.733538 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:05.734721 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:05.735450 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:05.918587 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:05.928259 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-0b07a064-9e7e-4756-b3b9-fb0e05d45eae tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.214224 Aug 02 09:54:05.939397 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1800/4234] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:05 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:54:06.968107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:06.968107 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:06.972601 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:06.973367 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:06.975237 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:06.976021 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:07.199505 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:07.212572 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-53fea71e-847a-47f7-aeab-0c1eb00ea704 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.259191 Aug 02 09:54:07.213620 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2435/4235] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:06 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:54:08.246177 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:08.246794 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:08.259581 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:08.260039 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:08.260858 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:08.261326 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:08.449962 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:08.462081 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-b409475d-43aa-4017-85ad-f2ac06eba981 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.219670 Aug 02 09:54:08.462739 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1801/4236] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:08 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:09.485689 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:09.486406 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:09.493932 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:09.494387 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:09.495168 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:09.495770 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:09.672054 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:09.681862 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-3db1ecda-2a1c-42b1-8678-d040ecbd3a5c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.200228 Aug 02 09:54:09.682456 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2436/4237] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:09 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:54:10.704891 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:10.706000 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:10.713650 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:10.714106 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:10.714941 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:10.715319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:10.887096 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:10.896334 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-de215777-17f9-4361-8cd1-73223d82338c tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.195477 Aug 02 09:54:10.896710 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1802/4238] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:10 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:11.928454 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:11.929405 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:11.936257 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:11.936712 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:11.937516 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:11.937960 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:12.126488 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:12.138087 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-2ab80622-bf41-40aa-a1f5-624f8928a0a4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.215406 Aug 02 09:54:12.139002 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2437/4239] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:11 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:13.160627 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:13.161859 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:13.169214 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:13.169683 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:13.170462 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:13.171007 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:13.333731 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:13.342398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-ed9ac497-3054-442a-aae5-cda1039401f6 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.185622 Aug 02 09:54:13.342972 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1803/4240] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:13 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:14.367556 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:14.368855 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:14.379653 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:14.380411 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:14.381882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:14.382761 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:14.576600 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:14.586029 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-9de5a2b7-b5c3-42f4-8f28-ed7510aa560a tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.225897 Aug 02 09:54:14.586723 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2438/4241] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:14 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:15.617209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:15.617958 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:15.624610 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:15.625063 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:15.625887 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:15.626327 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:15.783729 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:15.792166 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-1f537a92-18de-462a-a4c0-7bcbab299a55 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1762 microversion: 2.1 time: 0.179986 Aug 02 09:54:15.792753 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1804/4242] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:15 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1762 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:16.816740 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:16.818000 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:16.824594 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:16.825040 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:16.825833 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:16.826265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:16.989948 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:16.998565 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-52f7fab0-5325-4a48-9347-5036d1d05050 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1765 microversion: 2.1 time: 0.185655 Aug 02 09:54:16.999414 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2439/4243] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:16 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1765 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:54:29.830275 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:54:29.830989 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:54:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:54:51.976111 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1626616720"}} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:54:51.976705 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:51.978912 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_api:SELECT=12 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:51.979571 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG dbcounter [-] [117909] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:51.985426 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:51.985911 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:51.986769 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:51.987500 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:52.128247 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.network.security_group_api [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Removing security group d11e1811-8b8b-499a-9552-7cb40e412b0d from port e4bc4604-b093-43bc-a60b-4e4fd30b9620 Aug 02 09:54:52.452398 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-17188854-677f-478a-8f3c-755e298857d4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/action" status: 202 len: 0 microversion: 2.1 time: 0.480134 Aug 02 09:54:52.456352 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1805/4244] 10.222.0.100 () {60 vars in 1283 bytes} [Tue Aug 2 09:54:51 2022] POST /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:54:52.479879 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-6302321c-9227-4534-9873-b95ff7731144 req-ccad09d6-7584-45ab-804b-869f6574ca6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:54:52.484918 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_api:SELECT=12 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:52.506246 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG dbcounter [-] [117908] Writing DB stats nova_cell1:SELECT=36 {{(pid=117908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:54:52.512364 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-6302321c-9227-4534-9873-b95ff7731144 req-ccad09d6-7584-45ab-804b-869f6574ca6f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:52.512865 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-6302321c-9227-4534-9873-b95ff7731144 req-ccad09d6-7584-45ab-804b-869f6574ca6f service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:52.530265 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-6302321c-9227-4534-9873-b95ff7731144 req-ccad09d6-7584-45ab-804b-869f6574ca6f service nova] Creating event network-changed:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:54:52.537615 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-6302321c-9227-4534-9873-b95ff7731144 req-ccad09d6-7584-45ab-804b-869f6574ca6f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062464 Aug 02 09:54:52.538628 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2440/4245] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:54:53.590881 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:53.591487 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:53.597921 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:53.598370 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:53.599143 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:53.599576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:53.690696 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.objects.instance [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lazy-loading 'services' on Instance uuid 074a96c9-40b2-44c0-9021-19ea50c92451 {{(pid=117909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:54:53.772080 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-bd6f6f4f-3894-4b9e-a514-ac557ff53fbe tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments/fb0d3159-cb96-478a-a057-3513346b9cc2" status: 202 len: 0 microversion: 2.1 time: 0.185374 Aug 02 09:54:53.772994 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1806/4246] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:54:53 2022] DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments/fb0d3159-cb96-478a-a057-3513346b9cc2 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:54:53.781889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:53.784360 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:53.792458 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:53.793047 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:53.794091 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:53.794543 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:53.827090 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-75c7a50a-dd5d-42a6-a01b-833a66505a7d tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049795 Aug 02 09:54:53.827905 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2441/4247] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:54:53 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:54:54.555666 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [req-007762e8-c755-4d9a-893c-9f99ce2827f9 req-e1133c92-972f-4cce-91cb-9a983f897ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:54:54.567147 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-007762e8-c755-4d9a-893c-9f99ce2827f9 req-e1133c92-972f-4cce-91cb-9a983f897ed7 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:54.567608 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [req-007762e8-c755-4d9a-893c-9f99ce2827f9 req-e1133c92-972f-4cce-91cb-9a983f897ed7 service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:54.579658 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.compute.server_external_events [req-007762e8-c755-4d9a-893c-9f99ce2827f9 req-e1133c92-972f-4cce-91cb-9a983f897ed7 service nova] Creating event network-changed:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:54:54.586210 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [req-007762e8-c755-4d9a-893c-9f99ce2827f9 req-e1133c92-972f-4cce-91cb-9a983f897ed7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035527 Aug 02 09:54:54.589319 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1807/4248] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:54:54.839985 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:54.842378 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:54.851061 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:54.851525 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:54.852733 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:54.853337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:54.885647 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-bd74cd65-8b8b-42cd-8ec5-348ea1278660 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049561 Aug 02 09:54:54.886279 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2442/4249] 10.222.0.100 () {58 vars in 1307 bytes} [Tue Aug 2 09:54:54 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:54:54.899093 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:54.900576 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:54.907460 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:54.908163 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:54.909421 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:54.910200 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:54.995414 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] HTTP exception thrown: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 is not attached to volume fb0d3159-cb96-478a-a057-3513346b9cc2 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Request method failure captured: Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments/fb0d3159-cb96-478a-a057-3513346b9cc2 HTTP/1.1 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6PPzBN4aDI4ol6wkN_H6NcmELKjqhpIqJDt8W0dTikqsxK9GCsTms1tlGxBjexNmGdOPqsKiF6XmuRn4nM-Umh4Aye-0feXQhyUz0plmnybpL-Af7Z1ywrz8Q3adSZiK_kB5k5LUxAYcVNi2E93x6pVW0sRlnaxBnIWAeMO8KxZPIr8 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 557cbe65acb94a749a05118b3f3b70ff Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestMinimumBasicScenario-93196436 Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:54:54.998148 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestMinimumBasicScenario-93196436 Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 557cbe65acb94a749a05118b3f3b70ff Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestMinimumBasicScenario-93196436 Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-TestMinimumBasicScenario-93196436-project Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 0ea7a204b1d34f7dacfe9f468f565e65 Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestMinimumBasicScenario-93196436-project Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:54:54.999543 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 is not attached to volume fb0d3159-cb96-478a-a057-3513346b9cc2 Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'server_id': '074a96c9-40b2-44c0-9021-19ea50c92451', 'id': 'fb0d3159-cb96-478a-a057-3513346b9cc2'} Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fb0d3159-cb96-478a-a057-3513346b9cc2. Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:54:55.000209 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 is not attached to volume fb0d3159-cb96-478a-a057-3513346b9cc2 Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 is not attached to volume fb0d3159-cb96-478a-a057-3513346b9cc2 Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:55.001412 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Returning 404 to user: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 is not attached to volume fb0d3159-cb96-478a-a057-3513346b9cc2 {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:54:55.006469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-f236e9e4-5605-4a08-bdaa-94ec218f164f tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments/fb0d3159-cb96-478a-a057-3513346b9cc2" status: 404 len: 154 microversion: 2.1 time: 0.106195 Aug 02 09:54:55.006469 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1808/4250] 10.222.0.100 () {58 vars in 1421 bytes} [Tue Aug 2 09:54:54 2022] DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451/os-volume_attachments/fb0d3159-cb96-478a-a057-3513346b9cc2 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:54:56.173551 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:56.174113 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:56.181051 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:56.181531 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:56.182297 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:56.182732 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:56.207970 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Going to try to terminate instance {{(pid=117908) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:54:56.292286 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-03c3f4fc-9ba1-4db8-a278-9b9fa6170363 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 204 len: 0 microversion: 2.1 time: 0.121882 Aug 02 09:54:56.293417 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2443/4251] 10.222.0.100 () {58 vars in 1244 bytes} [Tue Aug 2 09:54:56 2022] DELETE /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:54:56.303846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:56.304468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:56.311125 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:56.311574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:56.312383 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:56.312824 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:56.449271 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:56.456886 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-e330e987-54ef-4ecc-90c2-4e5712f4c5f4 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1560 microversion: 2.1 time: 0.157504 Aug 02 09:54:56.457597 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1809/4252] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:56 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:57.478824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:57.479442 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.compute.api [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117908) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:57.485882 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:57.486333 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:57.487101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:57.487535 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:57.623889 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.policy [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:57.632660 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e7aed7a1-460b-4ded-863f-7d0c4ea05ccb tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1560 microversion: 2.1 time: 0.158199 Aug 02 09:54:57.633266 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2444/4253] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:57 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:54:58.657343 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:58.658534 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:58.669743 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:58.670574 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:58.672010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:58.672812 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:58.745269 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.policy [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea7a204b1d34f7dacfe9f468f565e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557cbe65acb94a749a05118b3f3b70ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117909) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:54:58.754758 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-95f166c9-0f3c-4b9e-9ce3-ba85de3328d3 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 200 len: 1518 microversion: 2.1 time: 0.103723 Aug 02 09:54:58.757130 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1810/4254] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:58 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 1518 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:54:58.788101 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [req-88169dff-9800-45d9-b192-6ca44914ef3d req-aa6eafd5-e85a-464e-9bba-d99a354280fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074a96c9-40b2-44c0-9021-19ea50c92451", "name": "network-vif-deleted", "tag": "e4bc4604-b093-43bc-a60b-4e4fd30b9620"}]} {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:54:58.800230 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-88169dff-9800-45d9-b192-6ca44914ef3d req-aa6eafd5-e85a-464e-9bba-d99a354280fe service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:58.800686 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG oslo_concurrency.lockutils [req-88169dff-9800-45d9-b192-6ca44914ef3d req-aa6eafd5-e85a-464e-9bba-d99a354280fe service nova] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:58.812834 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.compute.server_external_events [req-88169dff-9800-45d9-b192-6ca44914ef3d req-aa6eafd5-e85a-464e-9bba-d99a354280fe service nova] Creating event network-vif-deleted:e4bc4604-b093-43bc-a60b-4e4fd30b9620 for instance 074a96c9-40b2-44c0-9021-19ea50c92451 on hv-cinder-80382 Aug 02 09:54:58.819014 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [req-88169dff-9800-45d9-b192-6ca44914ef3d req-aa6eafd5-e85a-464e-9bba-d99a354280fe service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035797 Aug 02 09:54:58.819624 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2445/4255] 10.222.0.100 () {64 vars in 1322 bytes} [Tue Aug 2 09:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:54:59.775860 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '>' {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:59.776468 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.compute.api [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] [instance: 074a96c9-40b2-44c0-9021-19ea50c92451] Fetching instance by UUID {{(pid=117909) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:54:59.783221 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:59.783676 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:59.785092 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:54:59.785687 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG oslo_concurrency.lockutils [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Lock "a1278ed9-9478-4b17-bf68-714d9637c6d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:54:59.952566 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.wsgi [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] HTTP exception thrown: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 could not be found. Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Request method failure captured: Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: request: GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 HTTP/1.1 Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept: application/json Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Accept-Encoding: identity Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Connection: close Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Length: 0 Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Content-Type: application/json Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Host: 10.222.0.100 Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Openstack-System-Scope: None Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: User-Agent: python-urllib3/1.26.10 Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Auth-Token: gAAAAABi6PPzBN4aDI4ol6wkN_H6NcmELKjqhpIqJDt8W0dTikqsxK9GCsTms1tlGxBjexNmGdOPqsKiF6XmuRn4nM-Umh4Aye-0feXQhyUz0plmnybpL-Af7Z1ywrz8Q3adSZiK_kB5k5LUxAYcVNi2E93x6pVW0sRlnaxBnIWAeMO8KxZPIr8 Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Id: None Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Domain-Name: None Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Identity-Status: Confirmed Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Is-Admin-Project: True Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Id: default Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Domain-Name: Default Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Id: 557cbe65acb94a749a05118b3f3b70ff Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Project-Name: tempest-TestMinimumBasicScenario-93196436 Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Role: member,reader Aug 02 09:54:59.954173 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Roles: member,reader Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.100:8080", "publicURL": "http://10.222.0.100:8080/v1/AUTH_557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/557cbe65acb94a749a05118b3f3b70ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}] Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant: tempest-TestMinimumBasicScenario-93196436 Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Id: 557cbe65acb94a749a05118b3f3b70ff Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-Tenant-Name: tempest-TestMinimumBasicScenario-93196436 Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User: tempest-TestMinimumBasicScenario-93196436-project Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Id: default Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Domain-Name: Default Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Id: 0ea7a204b1d34f7dacfe9f468f565e65 Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: X-User-Name: tempest-TestMinimumBasicScenario-93196436-project Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: method: > Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: exception: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 could not be found. Aug 02 09:54:59.955619 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: action_args: {'id': '074a96c9-40b2-44c0-9021-19ea50c92451'} Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: {{(pid=117909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 could not be found. Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:54:59.957488 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 could not be found. Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 could not be found. Aug 02 09:54:59.958613 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: ERROR nova.api.openstack.wsgi Aug 02 09:54:59.959701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: DEBUG nova.api.openstack.wsgi [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Returning 404 to user: Instance 074a96c9-40b2-44c0-9021-19ea50c92451 could not be found. {{(pid=117909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:54:59.959701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO nova.api.openstack.requestlog [None req-4561516c-f67a-46fc-9a0c-43ba89388aa2 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451" status: 404 len: 111 microversion: 2.1 time: 0.183629 Aug 02 09:54:59.959701 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: [pid: 117909|app: 0|req: 1811/4256] 10.222.0.100 () {58 vars in 1241 bytes} [Tue Aug 2 09:54:59 2022] GET /compute/v2.1/servers/074a96c9-40b2-44c0-9021-19ea50c92451 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:54:59.966223 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: DEBUG nova.api.openstack.wsgi [None req-e355667c-f507-4c3d-badb-f3fdfc810dc8 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] Calling method '.version_select at 0x7f8c13704820>' {{(pid=117908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:54:59.985934 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO nova.api.openstack.requestlog [None req-e355667c-f507-4c3d-badb-f3fdfc810dc8 tempest-TestMinimumBasicScenario-93196436 tempest-TestMinimumBasicScenario-93196436-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2070207901" status: 202 len: 0 microversion: 2.1 time: 0.024538 Aug 02 09:54:59.986526 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: [pid: 117908|app: 0|req: 2446/4257] 10.222.0.100 () {58 vars in 1277 bytes} [Tue Aug 2 09:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2070207901 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:56:10.453840 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:56:10.454519 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:56:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:56:19.681010 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:56:19.681700 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:56:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:57:49.839720 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:57:49.840337 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:57:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:57:51.904824 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:57:51.905514 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:57:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:58:09.701464 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:58:09.702133 dv-cinder-803823-15-iscsi devstack@n-api.service[117908]: Tue Aug 2 09:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:59:30.462763 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:59:30.463366 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:59:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:59:39.690102 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:59:39.690718 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 09:59:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 10:00:00.342094 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 10:00:00.342846 dv-cinder-803823-15-iscsi devstack@n-api.service[117909]: Tue Aug 2 10:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!